-- Logs begin at Wed 2022-08-24 14:57:45 UTC, end at Wed 2022-08-24 15:55:46 UTC. -- Aug 24 15:28:49.043916 dv-cinder-846054-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 15:28:49.051768 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:28:49 2022] *** Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: nodename: dv-cinder-846054-2-iscsi Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: machine: x86_64 Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: clock source: unix Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: pcre jit disabled Aug 24 15:28:49.053738 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: detected number of CPU cores: 4 Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: current working directory: / Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: your processes number limit is 47680 Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: your memory page size is 4096 bytes Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: detected max file descriptor number: 2048 Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: lock engine: pthread robust mutexes Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: thunder lock: enabled Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 15:28:49.054293 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:28:49.093953 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: Python main interpreter initialized at 0x5555c58f29c0 Aug 24 15:28:49.093953 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: python threads support enabled Aug 24 15:28:49.093953 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: your server socket listen backlog is limited to 100 connections Aug 24 15:28:49.093953 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:28:49.094341 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:28:49.094422 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: *** Operational MODE: preforking *** Aug 24 15:28:49.094668 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:28:49.094668 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: spawned uWSGI master process (pid: 105633) Aug 24 15:28:49.094884 dv-cinder-846054-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 15:28:49.095430 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: spawned uWSGI worker 1 (pid: 105634, cores: 1) Aug 24 15:28:49.095754 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: spawned uWSGI worker 2 (pid: 105635, cores: 1) Aug 24 15:28:49.100120 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:28:49.756753 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:28:49.757740 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:28:50.845873 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:28:50.845873 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: from cryptography.utils import int_from_bytes Aug 24 15:28:50.846591 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:28:50.846591 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: from cryptography.utils import int_from_bytes Aug 24 15:28:50.859898 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:28:50.859898 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: from cryptography.utils import int_from_bytes Aug 24 15:28:50.860341 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:28:50.860341 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: from cryptography.utils import int_from_bytes Aug 24 15:28:53.319796 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:28:53.320260 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:28:53.320564 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:28:53.320917 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:28:53.321166 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:28:53.321298 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:28:53.321666 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.321752 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:28:53.321854 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.322071 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:28:53.322183 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.322428 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:28:53.322528 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.322707 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:28:53.322811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.323092 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.323187 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.323404 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.323497 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.323716 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.323811 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.324028 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.324122 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.324279 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.324372 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.324587 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.324760 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.324905 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-2-iscsi {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.325004 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.325221 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.325310 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.325521 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.325609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.325794 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.325891 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.326104 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.326198 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.326403 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.326496 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-2-iscsi {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.326748 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.326889 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.327049 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.327181 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.327352 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.327522 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.327682 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.328844 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.329058 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.329058 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.329446 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.329632 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.329810 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.330021 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.330201 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.330420 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.330614 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.330824 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.331047 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.331236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.331931 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.332123 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.332315 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.332511 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.332699 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.332888 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.333091 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.333286 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-2-iscsi {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.333475 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.333665 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.333873 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.334054 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.334054 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.334377 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.334377 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.334679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.334679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.334927 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-2-iscsi {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.335087 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.335213 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.335361 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.335495 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.335627 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.335788 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.335930 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336062 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336195 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336321 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336453 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336588 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336714 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336840 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.336976 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.337137 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.337270 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.337410 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.337561 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.337689 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.337814 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.337947 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.338080 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.338219 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.338346 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.338472 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.338586 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.338770 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.338919 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.339054 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.339193 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.339327 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.339453 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.339586 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.339755 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.339921 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340048 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340186 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340319 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340319 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340572 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340572 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340822 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.340822 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.341082 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.341221 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.341356 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.341489 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.341623 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.341623 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.341869 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342009 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342127 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342259 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342385 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342510 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342669 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342800 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.342925 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343050 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343186 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343310 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343449 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343575 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343708 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343840 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.343976 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.344102 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.344236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.344372 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.344505 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.344632 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.344765 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.344899 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345032 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345159 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345294 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345421 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345546 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345684 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345818 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.345954 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346080 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346080 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346315 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346315 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346562 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346711 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346848 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.346848 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.347092 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.347789 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.347922 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348057 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348191 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348317 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348317 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348564 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348695 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348821 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.348948 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.349080 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.349214 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.349341 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.349476 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.349609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.349734 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.349866 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.350003 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.350136 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.350262 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.350394 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.350519 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.350694 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.350906 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.351036 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.351173 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.351306 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.351681 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.351817 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.351953 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.352081 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.352213 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.352339 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.352471 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.352614 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.352748 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.352883 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.353015 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.353189 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.353319 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.353495 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.353625 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.353800 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.353930 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.354103 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.354234 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.354407 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.354543 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.354730 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.354877 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.355031 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.355168 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.355329 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.355465 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.355628 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.355755 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.355926 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.356062 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.356237 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.356383 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.356536 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.356667 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.356831 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.356961 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.357129 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.357258 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.357426 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.357562 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.357729 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.357865 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.358030 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.358157 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.358319 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.358454 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.358618 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.358776 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.358949 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.359077 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.359246 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.359381 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.359542 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.359681 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.359835 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.359965 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.360127 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.360265 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.360403 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.360540 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.360703 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.360832 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.360994 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.361131 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.361288 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.361432 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.361580 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.361710 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.361884 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.362012 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.362185 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.362329 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.362483 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.362619 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.363387 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.363598 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.363863 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.364010 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.364145 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.364278 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.364405 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.364538 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.364682 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.364816 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.365003 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.365146 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.365325 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.365462 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.365633 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.365771 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.365938 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.366068 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.366240 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.366369 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.366555 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:28:53.366710 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.366932 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.367063 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.367266 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.367409 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.367571 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.367699 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.367876 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.368007 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.368180 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.368324 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.368500 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.368630 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.368816 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.368949 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.369136 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.369273 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.369445 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.369573 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.369759 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.369902 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.370067 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.370221 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.370357 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.370489 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.370706 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.370838 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.371005 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.371149 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.371317 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.371456 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.371621 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.371760 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.371947 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.372160 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.372296 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.372424 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.372550 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.372675 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.372861 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.372993 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.373183 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.373311 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.373487 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.373627 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.373790 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.373922 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.374096 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.374231 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.374413 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.374545 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.374772 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.374915 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.375083 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.375213 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.375391 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.375519 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.375697 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.375840 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.376002 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.376133 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.376304 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.376445 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.376611 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.376740 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.376912 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.377052 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.377240 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.377385 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.377549 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.377677 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.377855 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.377983 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.378161 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.378306 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.379038 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.379185 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.379314 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.379507 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.379710 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.379851 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.380025 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.380163 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.380366 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.380498 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.380681 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.380806 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.380979 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.381116 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.381285 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.381424 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.381587 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.381727 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.381894 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.382023 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.382204 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.382334 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.382501 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.382631 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.382828 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.382971 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.383137 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.383275 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.383439 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.383580 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.383740 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.383869 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.384041 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.384179 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.384338 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.384475 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.384644 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.384782 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.384949 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.385092 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.385249 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.385380 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.385567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.385704 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.385869 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.386006 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.386167 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.386298 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.386471 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.386600 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.386798 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.386945 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.387095 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.387232 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.387402 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.387533 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.387704 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.387834 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.388006 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.388136 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.388317 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.388477 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.388617 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.388748 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.388921 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.389057 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.389223 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.389356 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.389526 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.389661 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.389834 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.389968 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.390142 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.390278 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.390444 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.390775 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.390910 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.391087 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.391239 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.391393 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.391521 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.391690 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.391827 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.391993 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.392133 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.392291 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.392420 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.392588 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.392710 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.392884 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.393025 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.393185 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.393316 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.393480 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.393618 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.393778 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.393942 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.394190 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.394319 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.394492 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.394662 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.394897 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.395034 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.395203 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.395330 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.395548 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.395677 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.395851 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.395983 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.396150 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.396278 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.396445 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.396582 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.396748 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.396877 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.397049 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.397180 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.397350 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.397481 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.397671 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.397811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.397980 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.398110 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.398284 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.398429 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.398587 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.398733 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.398926 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.399068 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.399268 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.399409 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.399573 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.399704 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.399914 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.400045 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.400231 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.400369 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.400555 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.400683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.400862 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.400992 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.401171 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.401378 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.401516 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.401642 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.401768 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.401894 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.402066 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.402214 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.402372 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.402502 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.402685 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.402819 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.403017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.403148 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.403328 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.403459 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.403648 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.403778 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.403954 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.404086 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.404276 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.404415 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.404585 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.404724 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.404903 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.405042 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.405206 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.405336 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.405519 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.405651 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.405836 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.405966 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.406144 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.406274 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.406458 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.406599 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.406788 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.406919 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.407102 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.407231 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.407403 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.407541 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.407708 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.407836 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.407999 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.408126 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.408312 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.408450 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.408621 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.408753 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.408938 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.409069 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.409247 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.409380 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.409585 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.409723 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.409892 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.410076 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.410237 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.410375 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.410510 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.410699 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.410846 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.410982 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.411111 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.411246 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.411427 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.411558 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.411723 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.411861 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.412021 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.412153 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.412324 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.412455 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.412630 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.412760 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.412955 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.413083 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.413234 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.413365 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.413531 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.413662 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.413837 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.413970 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.414138 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.414277 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.414436 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.414576 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.414758 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.414890 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.415061 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.415203 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.415375 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.415515 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.415677 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.415808 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.415993 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.416125 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.416303 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.416449 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.416599 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.416735 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.416897 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.417029 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.417197 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.417340 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.417504 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.417633 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.417803 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.417935 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.418100 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.418232 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.418400 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.418530 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.418764 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.418899 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.419039 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.419167 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.419335 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.419458 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.419643 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.419778 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.419949 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.420078 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.420248 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.420385 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.420547 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.420676 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.420847 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.420977 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.421148 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.421283 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.421464 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.421602 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.421767 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.421902 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.422068 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.422195 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.422374 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.422512 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.422696 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.422836 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.423014 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.423144 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.423319 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.423459 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.423626 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.423762 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.423943 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.424080 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.424246 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.424383 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.424549 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.424676 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.424843 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.424970 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.425645 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.425837 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.426022 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.426168 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.426343 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.426628 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.426802 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.426958 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.427087 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.427269 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.427398 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.427578 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.427718 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.427880 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.428009 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.428190 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.428327 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.428506 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.428656 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.428837 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.429069 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.429198 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.429401 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.429542 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.429702 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.429846 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.430019 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.430148 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.430327 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.430462 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.430632 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.430788 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.430952 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.431081 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.431252 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.431382 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.431550 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.431688 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.431853 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.431997 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.432148 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.432278 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.432446 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.432589 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.432745 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.432875 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.433043 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.433179 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.433350 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.433488 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.433648 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.433784 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.433947 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.434074 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.434241 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.434378 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.434541 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.434730 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.434860 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.434994 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.435161 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.435304 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.435458 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.435586 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.435757 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.435887 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.436057 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.436192 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.436368 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.436497 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.436671 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.436801 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.436994 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.437132 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.437301 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.437441 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.437603 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.437744 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.437902 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.438030 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.438201 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.438329 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.438511 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.438662 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.438836 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.438967 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.439133 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.439262 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.439435 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.439577 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.439736 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.439865 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.440032 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.440169 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.440336 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.440475 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.440638 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.440793 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.441478 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.441655 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.441786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.441923 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.442058 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.442186 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.442351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.442483 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.442688 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.442837 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.442966 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.443092 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.443275 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.443415 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.443572 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.443703 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.443869 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.444008 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.444171 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.444303 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.444471 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.444603 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.444766 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.444905 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.445068 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.445199 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.445363 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.445504 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.445670 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.445801 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.445967 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.446099 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.446262 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.446393 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.446556 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.446704 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.446883 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.447028 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.447183 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.447322 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.447478 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.447610 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.447776 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.447914 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.448087 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.448216 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.448382 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.448514 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.448676 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.448817 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.448974 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.449103 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.449266 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.449394 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.449561 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.449702 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.449857 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.449994 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.450168 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.450300 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.450473 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.450609 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.450775 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.450913 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.451082 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.451212 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.451380 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.451511 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.451676 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.451808 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.451971 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.452117 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.452259 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.452394 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.452549 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.452680 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.452844 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.452983 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.453140 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.453280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.453435 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.453566 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.453730 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.453935 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.454064 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.454198 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.454325 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.454450 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.454743 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.454895 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.455031 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.455167 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.455294 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.455420 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.455546 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.455717 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.455849 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.456059 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.456198 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.456375 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.456525 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.456803 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.457082 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.457221 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.457349 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.457476 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.457612 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.457747 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.457873 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.458001 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.458127 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.458304 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.458444 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.458687 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.458822 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.459002 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.459143 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.459307 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.459499 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.459617 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.459895 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.459998 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.460202 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.460298 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.460524 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.460666 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.460830 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.460930 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.461137 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.461237 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.461450 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.461547 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.461768 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.461905 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.462088 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.462239 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.462387 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.462556 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.462712 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.462894 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.463021 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.463227 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.463324 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.463574 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.463666 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.463894 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.463983 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.464197 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.464286 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.464503 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.464592 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.464807 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.464895 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.465113 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.465213 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.465418 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.465506 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.465716 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.465813 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.466019 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.466107 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.466323 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.466412 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.466621 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.466760 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.466961 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.467050 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.467264 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.467354 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.467561 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.467663 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.467862 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.467952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.468165 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.468253 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.468471 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.468570 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.468770 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.468859 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.469104 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.469199 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.469409 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.469499 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.469734 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.469830 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.470048 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.470148 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.470348 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.470448 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.470688 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.470781 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.470971 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.471058 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.471284 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.471409 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.471590 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.471754 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.472055 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.472193 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.472449 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.472536 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.472667 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.472881 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.472969 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.473191 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.473289 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.473491 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.473581 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.473792 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.473882 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.474097 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.474194 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.474416 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.474505 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.474745 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.474886 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.475045 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.475204 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.475342 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.475519 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.475656 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.475833 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.475955 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.476138 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.476268 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.476695 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.476931 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.477030 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.477238 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.477326 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.477536 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.477633 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.477900 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.477996 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.478204 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.478293 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.478531 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.478620 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.478860 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.478964 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.479175 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.479261 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.479493 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.479581 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.479794 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.479892 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.480112 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.480213 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.480401 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.480584 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.480718 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.480896 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.481032 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.481206 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.481338 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.481531 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.481646 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.481866 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.482015 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.482177 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.482275 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.482483 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.482571 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.482821 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.482925 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.483134 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.483224 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.483459 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.483561 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.483785 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.483888 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.484099 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.484189 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.484416 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.484505 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.484720 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.484821 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.485043 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.485132 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.485342 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.485429 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.485648 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.485738 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.485950 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.486039 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.486249 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.486373 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.486568 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.486729 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.487032 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.487122 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.487346 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.487444 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.488158 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.488259 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.488612 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.488702 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.488915 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.489054 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.489217 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.489375 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.489534 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.489687 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.489836 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.489997 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.490164 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.490325 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.490457 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.490635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.490800 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.490972 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.491120 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.491285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.491420 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.491593 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.491735 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.491900 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.492039 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.492207 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.492339 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.492530 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.492620 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.492836 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.492926 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.493160 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.493249 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.493474 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.493573 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.493797 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.493898 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.494121 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.494217 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.494425 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.494564 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.494768 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.494858 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.495078 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.495208 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.495384 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.495492 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.495689 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.495778 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.495993 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.496082 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.496312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.496409 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.496611 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.496700 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.496907 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.496996 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.497211 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.497301 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.497510 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.497600 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.497809 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.497899 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.498104 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.498195 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.498404 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.498493 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.498724 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.498816 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.499023 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.499122 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.499320 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.499440 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.499636 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.499735 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.499935 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.500025 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.500251 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.500380 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.500555 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.500654 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.500852 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.500942 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.501148 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.501237 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.501443 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.501610 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.501762 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.501850 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.502063 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.502190 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.502366 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.502465 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.502692 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.502782 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.502997 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.503085 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.503316 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.503417 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.504150 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.504238 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.504463 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.504613 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.504775 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.504923 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.505086 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.505229 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.505396 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.505575 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.505706 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.505883 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.506008 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.506213 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.506309 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.506524 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.506626 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.506871 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.506961 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.507191 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.507438 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.507543 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.507760 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.507850 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.508069 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.508159 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.508380 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.508483 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.508687 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.508776 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.508997 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.509089 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.509304 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.509468 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.509610 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.509700 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.509915 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.510004 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.510216 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.510314 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.510521 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.510775 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.510916 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.511133 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.511237 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.511450 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.511547 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.511766 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.511856 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.512079 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.512178 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.512385 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.512476 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.512694 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.512784 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.513003 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.513101 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.513311 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.513409 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.513619 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.513709 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.513925 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.514016 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.514229 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.514318 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.514536 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.514626 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.514868 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.514970 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.515175 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.515264 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.515480 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.515578 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.515785 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.515875 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.516091 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.516181 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.516396 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.516494 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.516698 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.516797 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.517002 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.517092 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.517308 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.517405 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.517625 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.517715 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.517950 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.518040 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.518272 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.518394 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.518580 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.518779 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.518947 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.519107 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.519349 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.519470 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.519858 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.519956 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.520165 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.520260 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.520558 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.520663 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.520782 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.521131 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.521378 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.521487 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.521686 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.521786 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.521996 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.522090 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.522318 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.522482 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.522614 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.522768 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.522935 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.523027 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.523240 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.523345 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.523543 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.523756 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.523846 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.524072 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.524171 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.524408 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.524497 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.524716 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.524804 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.525028 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.525126 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.525331 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.525421 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.525644 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.525855 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.525971 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.526199 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.526297 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.526509 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.526606 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.526853 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.526945 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.527175 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.527264 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.527479 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.527575 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.527774 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.527872 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.528090 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.528189 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.528390 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.528478 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.528689 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.528786 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.528999 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.529093 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.529304 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.529533 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.529622 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.529880 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.529970 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.530183 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.530272 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.530487 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.530577 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.530814 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.530940 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.531120 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.531339 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.531429 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.531655 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.531753 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.531982 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.532072 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.532289 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.532377 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.532584 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.532673 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.532891 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.532980 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.533189 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.533287 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.533486 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.533576 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.533787 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.533907 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.534098 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.534208 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.534407 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.534535 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.534777 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.534877 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.535191 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.535302 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.535500 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.535590 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.535827 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.535917 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.536132 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.536231 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.536437 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.536534 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.536741 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.536830 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.537089 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.537196 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.537352 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.537441 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.537654 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.537742 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.537957 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.538059 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.538258 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.538348 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.538568 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.538688 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.538896 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.538989 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.539200 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.539338 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.539501 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.539597 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.539811 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.539901 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.540112 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.540355 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.540446 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.540686 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.540784 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.541002 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.541091 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.541304 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.541391 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.541645 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.541742 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.541947 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.542037 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.542247 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.542337 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.542547 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.542657 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.542888 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.542977 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.543192 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.543280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.543498 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.543589 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.543805 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.543904 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.544106 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.544351 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.544449 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.544688 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.544785 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.544992 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.545081 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.545297 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.545400 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.545601 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.545691 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.545904 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.545993 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.546207 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.546301 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.546509 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.546606 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.546838 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.546928 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.547143 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.547234 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.547450 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.547546 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.547769 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.547856 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.548078 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.548177 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.548388 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.548477 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.548695 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.548792 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.549004 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.549099 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.549318 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.549408 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.549628 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.549726 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.549937 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.550026 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.550927 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.551141 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.551294 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.551500 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.551594 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.551826 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.551915 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.552131 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.552228 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.552489 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.552679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.552835 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.552984 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.553135 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.553279 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.553454 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.553545 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.553760 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.553847 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.554075 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.554169 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.554385 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.554474 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.554712 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.554805 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.555027 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.555131 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.555330 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.555428 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.555646 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.555734 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.555978 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.556070 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.556293 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.556382 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.556599 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.556696 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.556897 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.557019 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.557197 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.557332 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.557651 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.557970 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.558279 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.558601 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.558751 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.558947 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.559053 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.559267 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.559445 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.559576 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.559763 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.559887 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.560072 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.560217 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.560375 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.560556 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.560730 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.560887 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.560982 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.561211 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.561305 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.561515 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.561605 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.561819 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.561919 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.562122 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.562213 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.562423 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.562510 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.562746 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.562852 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.563060 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.563148 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.563361 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.563450 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.563656 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.563754 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.563954 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.564044 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.564254 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.564349 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.564551 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.564648 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.564850 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.564938 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.565150 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.565240 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.565456 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.565546 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.565751 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.565883 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.566129 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.566317 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.566619 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.566774 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.566948 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.567044 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.567253 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.567342 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.567555 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.567702 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.567863 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.567961 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.568164 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.568254 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.568466 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.568556 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.568767 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.568947 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.569070 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.569241 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.569371 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.569460 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.569704 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.569801 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.570013 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.570110 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.570320 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.570409 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.570628 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.570738 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.570957 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.571061 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.571261 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.571388 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.571566 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.571654 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.571884 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.571975 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.572205 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.572293 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.572505 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.572595 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.572808 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.572897 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.573124 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.573212 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.573435 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.573522 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.573744 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.573833 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.574050 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.574139 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.574355 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.574444 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.574703 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.574798 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.574989 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.575090 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.575294 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.575394 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.575602 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.575699 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.575907 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.575997 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.576217 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.576316 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.576520 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.576616 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.576824 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.576913 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.577136 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.577232 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.577443 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.577532 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.577764 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.577860 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.578071 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.578159 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.578375 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.578462 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.578697 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.578787 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.579010 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.579100 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.579319 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.579408 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.579640 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.579729 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.579949 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.580047 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.580259 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.580357 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.580575 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.580704 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.580890 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.580980 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.581214 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.581304 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.581992 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:28:53.582098 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.582676 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.582999 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.583333 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.583684 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.584002 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.584349 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.584680 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.584998 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.585313 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.585622 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:28:53.585865 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:28:53.736646 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Registered counter for database nova_api Aug 24 15:28:53.739966 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Registered counter for database nova_api Aug 24 15:28:53.758564 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:53.760380 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:53.765194 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:53.766864 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:53.821835 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.context [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d7efa9e-3929-4bb8-bb7f-bcfc584eee15(cell1) {{(pid=105635) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:28:53.823140 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.context [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d7efa9e-3929-4bb8-bb7f-bcfc584eee15(cell1) {{(pid=105634) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:28:53.825629 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.826093 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.826969 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.827442 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.827717 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.828442 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.828881 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.829048 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.829767 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.830212 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.831346 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.833032 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.834223 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Registered counter for database nova_cell0 Aug 24 15:28:53.835052 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Registered counter for database nova_cell0 Aug 24 15:28:53.840031 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Registered counter for database nova_cell1 Aug 24 15:28:53.841669 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Registered counter for database nova_cell1 Aug 24 15:28:53.850170 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:53.850982 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:53.852304 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:53.855817 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:53.857051 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:53.859557 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:53.997077 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:53.998676 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:54.008004 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Registered counter for database nova_cell0 Aug 24 15:28:54.008597 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Registered counter for database nova_cell0 Aug 24 15:28:54.017223 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:54.021081 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:28:54.021946 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:54.025463 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:28:54.370121 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:28:54.377413 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:28:54.377792 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:28:54.385375 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:28:54.720317 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:28:54.727385 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:28:54.731478 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:28:54.732650 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5555c58f29c0 pid: 105634 (default app) Aug 24 15:28:54.734724 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:54.735921 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Aug 24 15:28:54.736322 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Wed Aug 24 15:28:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:54.737455 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-21c51dc2-643c-426e-b295-8fdf38f9bfef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:28:54.742979 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5555c58f29c0 pid: 105635 (default app) Aug 24 15:30:13.393639 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:13.395576 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002347 Aug 24 15:30:13.408527 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:13 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:13.413765 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:SELECT=3 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:13.415848 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_cell0:SELECT=3 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:13.416942 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_cell1:SELECT=3 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:13.418041 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:14.366805 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-af35ca6d-4334-47ce-8f58-0b50e2e43152 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:14.401652 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-af35ca6d-4334-47ce-8f58-0b50e2e43152 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.997510 Aug 24 15:30:14.402442 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 15:30:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:16.811602 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:16.812607 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-76edc799-f5a7-46ac-b9bb-7186327f1cb0 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 15:30:16.814976 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 3/4] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:17.265447 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-553983aa-3ee4-48c7-a06b-bebb57d6e523 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:17.286915 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:30:17.286915 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: warnings.warn(msg) Aug 24 15:30:17.316169 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-553983aa-3ee4-48c7-a06b-bebb57d6e523 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496735 Aug 24 15:30:17.317094 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 2/5] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:17.330786 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:17.332382 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:17.333151 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell1:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:17.334215 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:17.542376 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-b7a63e25-bbaf-4edb-946d-cc514dc2df5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:17.546702 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:30:17.546702 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: warnings.warn(msg) Aug 24 15:30:17.615345 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-b7a63e25-bbaf-4edb-946d-cc514dc2df5a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289546 Aug 24 15:30:17.615860 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 4/6] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 15:30:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:20.029206 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-553983aa-3ee4-48c7-a06b-bebb57d6e523 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:20.030218 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-553983aa-3ee4-48c7-a06b-bebb57d6e523 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 15:30:20.030827 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 3/7] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:20.743652 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-23bfeb0c-3060-4600-920c-1263949b9904 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:20.765597 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:30:20.765597 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: warnings.warn(msg) Aug 24 15:30:20.790212 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-23bfeb0c-3060-4600-920c-1263949b9904 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.752729 Aug 24 15:30:20.791782 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 5/8] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:20.803620 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-5406cc5c-b02e-4175-b6b8-8293b317b322 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:20.807178 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:30:20.807178 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: warnings.warn(msg) Aug 24 15:30:20.841583 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-5406cc5c-b02e-4175-b6b8-8293b317b322 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041662 Aug 24 15:30:20.842294 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 4/9] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 15:30:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:23.263537 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-23bfeb0c-3060-4600-920c-1263949b9904 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:23.264552 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-23bfeb0c-3060-4600-920c-1263949b9904 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 15:30:23.264953 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:23.688068 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-08258d4f-0944-4a42-ae86-86fe65dcf8aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "ram": 1024, "swap": 0, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:23.707090 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-08258d4f-0944-4a42-ae86-86fe65dcf8aa admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436215 Aug 24 15:30:23.707623 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 5/11] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:23.719439 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-8ee3f7af-33fc-4f8e-958b-6a1f55f9b748 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:23.744734 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-8ee3f7af-33fc-4f8e-958b-6a1f55f9b748 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028733 Aug 24 15:30:23.745318 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 7/12] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 15:30:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:26.152900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-08258d4f-0944-4a42-ae86-86fe65dcf8aa admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:26.153975 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-08258d4f-0944-4a42-ae86-86fe65dcf8aa admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 15:30:26.154381 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 6/13] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:26.635873 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-a841ba79-96cc-4c32-b4f5-aa758d3723cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "name": "ds2G", "ram": 2048, "id": "d3"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:26.657891 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-a841ba79-96cc-4c32-b4f5-aa758d3723cc admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496863 Aug 24 15:30:26.659234 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 8/14] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:26.671493 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-bb3b43a5-4149-4169-bba7-f144afea5ddd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:26.700152 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-bb3b43a5-4149-4169-bba7-f144afea5ddd admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032501 Aug 24 15:30:26.700980 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 7/15] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 15:30:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:29.148926 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-a841ba79-96cc-4c32-b4f5-aa758d3723cc admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:29.150887 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-a841ba79-96cc-4c32-b4f5-aa758d3723cc admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002628 Aug 24 15:30:29.155291 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 9/16] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:29.679294 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-e8edab87-1aa7-44be-b813-9212b1ba0c0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 20, "name": "ds4G", "vcpus": 4}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:29.703383 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-e8edab87-1aa7-44be-b813-9212b1ba0c0e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.545180 Aug 24 15:30:29.704288 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 8/17] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:29.717267 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-e052e1e3-f0b1-489b-9d0b-dc284a1bd970 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:29.745437 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-e052e1e3-f0b1-489b-9d0b-dc284a1bd970 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031820 Aug 24 15:30:29.746023 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 10/18] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 15:30:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:32.194378 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-e8edab87-1aa7-44be-b813-9212b1ba0c0e admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:32.195438 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-e8edab87-1aa7-44be-b813-9212b1ba0c0e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 15:30:32.195841 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 9/19] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:32.692223 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-22cd32ad-f3aa-4ee4-b25d-68fa68164b4c admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:32.718614 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-22cd32ad-f3aa-4ee4-b25d-68fa68164b4c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.515653 Aug 24 15:30:32.719496 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 11/20] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 15:30:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:30:35.209707 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-e8edab87-1aa7-44be-b813-9212b1ba0c0e admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:35.210860 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-e8edab87-1aa7-44be-b813-9212b1ba0c0e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 24 15:30:35.211282 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 10/21] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:35.721889 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-296e5e43-e54d-4a6d-a9d8-7846c5c8ad72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "name": "m1.tiny"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:35.745911 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-296e5e43-e54d-4a6d-a9d8-7846c5c8ad72 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.528092 Aug 24 15:30:35.747078 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 12/22] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:35.759220 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-bfe9acd5-3fb0-4ba7-baae-65dccd480b8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:35.788252 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-bfe9acd5-3fb0-4ba7-baae-65dccd480b8f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032670 Aug 24 15:30:35.789217 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 11/23] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 15:30:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:38.325822 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-296e5e43-e54d-4a6d-a9d8-7846c5c8ad72 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:38.326885 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-296e5e43-e54d-4a6d-a9d8-7846c5c8ad72 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 15:30:38.327290 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 13/24] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:38.839252 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-9436bebd-494b-4870-843f-e16f344754bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 2048}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:38.858171 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-9436bebd-494b-4870-843f-e16f344754bc admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.524194 Aug 24 15:30:38.859054 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 12/25] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:30:38.871923 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-be0388f1-7acd-4217-a871-7d9281d0239b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:38.896884 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-be0388f1-7acd-4217-a871-7d9281d0239b admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029253 Aug 24 15:30:38.897548 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 14/26] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 15:30:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:41.262291 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-9436bebd-494b-4870-843f-e16f344754bc admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:41.263354 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-9436bebd-494b-4870-843f-e16f344754bc admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 24 15:30:41.263933 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:41.728170 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-026d4b03-7be1-4482-9c0e-fd2f36cff096 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "vcpus": 2}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:41.750156 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-026d4b03-7be1-4482-9c0e-fd2f36cff096 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.480162 Aug 24 15:30:41.751094 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 15/28] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:41.765609 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-08013fbd-71a3-4653-a730-61082065ba31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:41.792310 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-08013fbd-71a3-4653-a730-61082065ba31 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032921 Aug 24 15:30:41.792931 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 14/29] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 15:30:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:44.236090 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-026d4b03-7be1-4482-9c0e-fd2f36cff096 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:44.237368 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-026d4b03-7be1-4482-9c0e-fd2f36cff096 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 15:30:44.237771 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:44.666211 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-a4edb85f-c53a-4047-a5a7-1b58e42a9fea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:44.672393 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:44.688235 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-a4edb85f-c53a-4047-a5a7-1b58e42a9fea admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444448 Aug 24 15:30:44.689054 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 15/31] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:44.702217 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-b0fe01ef-6ef4-4618-8cab-e52e68fe4f04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:44.727072 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-b0fe01ef-6ef4-4618-8cab-e52e68fe4f04 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029641 Aug 24 15:30:44.727660 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 17/32] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 15:30:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:47.171283 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-a4edb85f-c53a-4047-a5a7-1b58e42a9fea admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:47.172297 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-a4edb85f-c53a-4047-a5a7-1b58e42a9fea admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 15:30:47.172704 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 16/33] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:47.638413 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-a434b43a-3ddf-45b7-bba9-cc719c432f52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "id": "5", "disk": 160}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:47.644970 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:47.661873 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-a434b43a-3ddf-45b7-bba9-cc719c432f52 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.483114 Aug 24 15:30:47.662438 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 18/34] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 15:30:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:30:47.677810 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-acd5bd67-d1d8-439e-8db6-e3146f1bd533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:47.706777 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-acd5bd67-d1d8-439e-8db6-e3146f1bd533 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033236 Aug 24 15:30:47.707699 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 17/35] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 15:30:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:06.405253 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-a434b43a-3ddf-45b7-bba9-cc719c432f52 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:06.406273 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-a434b43a-3ddf-45b7-bba9-cc719c432f52 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 24 15:31:06.406703 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 19/36] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:31:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:06.417473 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:06.802178 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-7592f4dc-9ca4-499e-8b59-abef32368cbd admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:06.820272 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-7592f4dc-9ca4-499e-8b59-abef32368cbd admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407327 Aug 24 15:31:06.820806 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 15:31:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:07.878741 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-a434b43a-3ddf-45b7-bba9-cc719c432f52 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:07.879759 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-a434b43a-3ddf-45b7-bba9-cc719c432f52 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 15:31:07.880166 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 20/38] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:08.399109 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-03c3f78e-76d2-4b07-9c0c-e2b8d433febf admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:08.405403 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.wsgi [None req-03c3f78e-76d2-4b07-9c0c-e2b8d433febf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-03c3f78e-76d2-4b07-9c0c-e2b8d433febf admin admin] Request method failure captured: Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Accept: application/json Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Accept-Encoding: gzip, deflate Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Connection: keep-alive Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Content-Length: 0 Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Host: 10.222.0.73 Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Openstack-Api-Version: compute 2.90 Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Openstack-System-Scope: None Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: User-Agent: python-novaclient Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Auth-Token: gAAAAABjBkQ79b5qYfDqS8Njbi2WZVl2bjld5GKzC5L1_h3yaRUrY72EJfaPpWCQRU43cu4z4Z2SBNONfp-UPC_v5kxT3lGErkkHlmDggX1QmITXiuyYlY_aMmkJCMoLk0kHJij7fYrCS-pfq2lRS4X6zj72rUJQ0EN6HDNpwt-5TwqL0J_aeaM Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Domain-Id: None Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Domain-Name: None Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Identity-Status: Confirmed Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Is-Admin-Project: True Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Domain-Id: default Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Domain-Name: Default Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Name: admin Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Role: reader,member,admin Aug 24 15:31:08.408679 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Roles: reader,member,admin Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5e88980106c84e4fadc67759de8e9449", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5e88980106c84e4fadc67759de8e9449"}]}] Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant: admin Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant-Name: admin Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User: admin Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Domain-Id: default Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Domain-Name: Default Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Id: 75821779c93e4039bcee682de1f82886 Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Name: admin Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: method: > Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: exception: Flavor 42 could not be found. Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: action_args: {'id': '42'} Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:31:08.410351 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:08.411322 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.412683 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-03c3f78e-76d2-4b07-9c0c-e2b8d433febf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:31:08.414034 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-03c3f78e-76d2-4b07-9c0c-e2b8d433febf admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393453 Aug 24 15:31:08.414034 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 15:31:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:31:08.420051 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-c633a8e5-d6eb-4a7d-a734-93219ad8d618 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:08.442783 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-c633a8e5-d6eb-4a7d-a734-93219ad8d618 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026545 Aug 24 15:31:08.443330 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 21/40] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 15:31:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:08.453723 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d5dc2581-a74c-47ad-a77e-6baf43eefc92 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:08.478433 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-d5dc2581-a74c-47ad-a77e-6baf43eefc92 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028870 Aug 24 15:31:08.479031 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 15:31:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:08.488765 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3afa192a-aca4-43de-8598-5cbaf8be8221 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:08.494570 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-3afa192a-aca4-43de-8598-5cbaf8be8221 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3afa192a-aca4-43de-8598-5cbaf8be8221 admin admin] Request method failure captured: Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Accept: application/json Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Connection: keep-alive Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Content-Length: 0 Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Host: 10.222.0.73 Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.90 Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjBkQ79b5qYfDqS8Njbi2WZVl2bjld5GKzC5L1_h3yaRUrY72EJfaPpWCQRU43cu4z4Z2SBNONfp-UPC_v5kxT3lGErkkHlmDggX1QmITXiuyYlY_aMmkJCMoLk0kHJij7fYrCS-pfq2lRS4X6zj72rUJQ0EN6HDNpwt-5TwqL0J_aeaM Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Role: reader,member,admin Aug 24 15:31:08.498017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Roles: reader,member,admin Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5e88980106c84e4fadc67759de8e9449", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5e88980106c84e4fadc67759de8e9449"}]}] Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant: admin Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User: admin Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Id: 75821779c93e4039bcee682de1f82886 Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Name: admin Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: method: > Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: exception: Flavor 42 could not be found. Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: action_args: {'id': '42'} Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:31:08.499609 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:08.500485 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:08.501567 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3afa192a-aca4-43de-8598-5cbaf8be8221 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:31:08.502615 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-3afa192a-aca4-43de-8598-5cbaf8be8221 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014302 Aug 24 15:31:08.502615 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 15:31:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:31:09.476181 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d5dc2581-a74c-47ad-a77e-6baf43eefc92 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:09.477192 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-d5dc2581-a74c-47ad-a77e-6baf43eefc92 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 24 15:31:09.477592 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 21/43] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:10.003778 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-cfe2d0cf-ac3c-4c2f-b5c1-5a141aa95b0c admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:10.009714 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-cfe2d0cf-ac3c-4c2f-b5c1-5a141aa95b0c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-cfe2d0cf-ac3c-4c2f-b5c1-5a141aa95b0c admin admin] Request method failure captured: Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Accept: application/json Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Connection: keep-alive Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Content-Length: 0 Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Host: 10.222.0.73 Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.90 Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjBkQ92eISNNQErdQiWFLdNDxyN87M0YDZLLIwUndV-DScokxQfmH7NWfP-3FFyNhA9WriYnVthHhpKqLPgI1WYOR5DMjYZliftlqDhkaKDKCy78fHOpOqfe46VS33DwbDMr99qcLdn6IFSMw_jfGoVI7r3XW-pUplEhXEv5bC4RkojlI Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Role: reader,member,admin Aug 24 15:31:10.011280 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Roles: reader,member,admin Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5e88980106c84e4fadc67759de8e9449", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5e88980106c84e4fadc67759de8e9449"}]}] Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant: admin Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User: admin Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Id: 75821779c93e4039bcee682de1f82886 Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Name: admin Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: method: > Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: exception: Flavor 84 could not be found. Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: action_args: {'id': '84'} Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:31:10.014635 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:10.015636 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.016952 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-cfe2d0cf-ac3c-4c2f-b5c1-5a141aa95b0c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:31:10.018382 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-cfe2d0cf-ac3c-4c2f-b5c1-5a141aa95b0c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397678 Aug 24 15:31:10.018382 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 15:31:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:31:10.024261 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-a543eceb-2033-4bb1-83ee-f01c379c5aca admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:10.039252 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-a543eceb-2033-4bb1-83ee-f01c379c5aca admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019202 Aug 24 15:31:10.039790 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 15:31:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:10.050208 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-15ae43e0-41d5-4fd4-9c68-905520738de1 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:10.065675 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-15ae43e0-41d5-4fd4-9c68-905520738de1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019068 Aug 24 15:31:10.066195 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 15:31:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:10.075434 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-cda9e700-395e-47cf-8820-1860968087ac admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:10.080732 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.wsgi [None req-cda9e700-395e-47cf-8820-1860968087ac admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-cda9e700-395e-47cf-8820-1860968087ac admin admin] Request method failure captured: Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Accept: application/json Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Accept-Encoding: gzip, deflate Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Connection: keep-alive Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Content-Length: 0 Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Host: 10.222.0.73 Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Openstack-Api-Version: compute 2.90 Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Openstack-System-Scope: None Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: User-Agent: python-novaclient Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Auth-Token: gAAAAABjBkQ92eISNNQErdQiWFLdNDxyN87M0YDZLLIwUndV-DScokxQfmH7NWfP-3FFyNhA9WriYnVthHhpKqLPgI1WYOR5DMjYZliftlqDhkaKDKCy78fHOpOqfe46VS33DwbDMr99qcLdn6IFSMw_jfGoVI7r3XW-pUplEhXEv5bC4RkojlI Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Domain-Id: None Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Domain-Name: None Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Identity-Status: Confirmed Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Is-Admin-Project: True Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Domain-Id: default Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Domain-Name: Default Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Name: admin Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Role: reader,member,admin Aug 24 15:31:10.082236 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Roles: reader,member,admin Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5e88980106c84e4fadc67759de8e9449", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5e88980106c84e4fadc67759de8e9449"}]}] Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant: admin Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant-Name: admin Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User: admin Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Domain-Id: default Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Domain-Name: Default Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Id: 75821779c93e4039bcee682de1f82886 Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Name: admin Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: method: > Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: exception: Flavor 84 could not be found. Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: action_args: {'id': '84'} Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:31:10.083786 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:10.084811 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:10.086119 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-cda9e700-395e-47cf-8820-1860968087ac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:31:10.087535 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-cda9e700-395e-47cf-8820-1860968087ac admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011785 Aug 24 15:31:10.087535 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 15:31:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 15:31:11.053928 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-15ae43e0-41d5-4fd4-9c68-905520738de1 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:11.054971 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-15ae43e0-41d5-4fd4-9c68-905520738de1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 15:31:11.055366 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:11.586490 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-6c80d358-0809-4798-bbc4-6d5d31e05efa admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:11.592287 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.wsgi [None req-6c80d358-0809-4798-bbc4-6d5d31e05efa admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-6c80d358-0809-4798-bbc4-6d5d31e05efa admin admin] Request method failure captured: Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Accept: application/json Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Accept-Encoding: gzip, deflate Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Connection: keep-alive Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Content-Length: 0 Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Host: 10.222.0.73 Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Openstack-Api-Version: compute 2.90 Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Openstack-System-Scope: None Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: User-Agent: python-novaclient Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Auth-Token: gAAAAABjBkQ-QfyNADHpk1bkcM_OeVbokN4daFpa_ouV0rX-woy4-9SI7J32CscuQVit-nS1WrNyVCLkkOZJa6D677plao1zWyshslEjI3Ym3gtgF72W5OUVisZEQDKmIx8tjMzEzzPb8w9pXvfOfebFlG34QwV0sD3n7R4MSQxmFKyP2A19KTo Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Domain-Id: None Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Domain-Name: None Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Identity-Status: Confirmed Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Is-Admin-Project: True Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Domain-Id: default Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Domain-Name: Default Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Project-Name: admin Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Role: reader,member,admin Aug 24 15:31:11.593783 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Roles: reader,member,admin Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5e88980106c84e4fadc67759de8e9449", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5e88980106c84e4fadc67759de8e9449"}]}] Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant: admin Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-Tenant-Name: admin Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User: admin Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Domain-Id: default Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Domain-Name: Default Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Id: 75821779c93e4039bcee682de1f82886 Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: X-User-Name: admin Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: method: > Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: exception: Flavor 451 could not be found. Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: action_args: {'id': '451'} Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:31:11.595312 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:11.596506 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.597900 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-6c80d358-0809-4798-bbc4-6d5d31e05efa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:31:11.599255 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-6c80d358-0809-4798-bbc4-6d5d31e05efa admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.401527 Aug 24 15:31:11.599255 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 15:31:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 15:31:11.604877 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-6d759be4-0873-41d1-a394-30e6f15265e8 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:11.620553 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-6d759be4-0873-41d1-a394-30e6f15265e8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019267 Aug 24 15:31:11.621104 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 15:31:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:11.631233 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:11.645959 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018294 Aug 24 15:31:11.646489 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 25/51] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 15:31:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:11.656510 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-bcc65cc0-0e01-4bef-bbe1-d0a9464d3ad2 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:11.661761 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-bcc65cc0-0e01-4bef-bbe1-d0a9464d3ad2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-bcc65cc0-0e01-4bef-bbe1-d0a9464d3ad2 admin admin] Request method failure captured: Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Accept: application/json Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Connection: keep-alive Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Content-Length: 0 Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Host: 10.222.0.73 Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.90 Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjBkQ-QfyNADHpk1bkcM_OeVbokN4daFpa_ouV0rX-woy4-9SI7J32CscuQVit-nS1WrNyVCLkkOZJa6D677plao1zWyshslEjI3Ym3gtgF72W5OUVisZEQDKmIx8tjMzEzzPb8w9pXvfOfebFlG34QwV0sD3n7R4MSQxmFKyP2A19KTo Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Role: reader,member,admin Aug 24 15:31:11.663285 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Roles: reader,member,admin Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5e88980106c84e4fadc67759de8e9449", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5e88980106c84e4fadc67759de8e9449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5e88980106c84e4fadc67759de8e9449"}]}] Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant: admin Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant-Id: 5e88980106c84e4fadc67759de8e9449 Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User: admin Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Id: 75821779c93e4039bcee682de1f82886 Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: X-User-Name: admin Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: method: > Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: exception: Flavor 451 could not be found. Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: action_args: {'id': '451'} Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:31:11.664951 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:11.666017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Aug 24 15:31:11.667418 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-bcc65cc0-0e01-4bef-bbe1-d0a9464d3ad2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:31:11.668691 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-bcc65cc0-0e01-4bef-bbe1-d0a9464d3ad2 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012461 Aug 24 15:31:11.668691 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 27/52] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 15:31:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:31:12.636507 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:12.637526 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 15:31:12.637921 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:13.163414 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-aba6ee4f-20aa-43ac-ae80-cd1e642fd6bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:13.183555 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-aba6ee4f-20aa-43ac-ae80-cd1e642fd6bd admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407980 Aug 24 15:31:13.184113 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 28/54] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 15:31:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:31:14.163116 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:14.164146 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 15:31:14.164540 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:14.691872 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-1d0a2e6f-5e91-47bd-b510-ab3cf5f4b2bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:14.710446 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-1d0a2e6f-5e91-47bd-b510-ab3cf5f4b2bd admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408815 Aug 24 15:31:14.711046 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 29/56] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 15:31:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:31:15.714808 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:15.715810 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 24 15:31:15.716207 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:16.266718 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-e1ed979b-84f7-4d94-af65-3d771a138767 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:16.285761 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-e1ed979b-84f7-4d94-af65-3d771a138767 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.429763 Aug 24 15:31:16.286298 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 30/58] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 15:31:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:31:17.276904 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:17.277909 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 15:31:17.278651 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:17.803836 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-493159a3-12c7-4535-bf6b-6c4ecb1ddfd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:17.822551 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-493159a3-12c7-4535-bf6b-6c4ecb1ddfd2 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.402979 Aug 24 15:31:17.823060 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 31/60] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 15:31:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:31:18.803615 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:18.804662 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 15:31:18.805062 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 30/61] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:19.342578 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-596a93df-9c47-479f-9e7e-d8a951118b60 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:19.362804 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-596a93df-9c47-479f-9e7e-d8a951118b60 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410495 Aug 24 15:31:19.363342 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 32/62] 10.222.0.73 () {60 vars in 1202 bytes} [Wed Aug 24 15:31:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:13.399603 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:13.402826 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-8ab6ea8d-5ee6-49c3-8f73-7b130cb1a403 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Aug 24 15:32:13.403183 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 15:32:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:32:13.415509 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:13.823481 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-5ff4ecbd-f9bb-4746-8e63-100f1ada283b admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:13.845922 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-5ff4ecbd-f9bb-4746-8e63-100f1ada283b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435194 Aug 24 15:32:13.847325 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 15:32:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:13.868275 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:SELECT=14 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:13.872124 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-2c38d0a8-93a8-4279-b84b-9e43f4969430 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:13.881226 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-2c38d0a8-93a8-4279-b84b-9e43f4969430 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014310 Aug 24 15:32:13.882003 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 32/65] 10.222.0.73 () {60 vars in 1283 bytes} [Wed Aug 24 15:32:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:13.894604 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-531688a9-1dee-4420-a0b7-fe1355e53869 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:13.906001 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-531688a9-1dee-4420-a0b7-fe1355e53869 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015723 Aug 24 15:32:13.906566 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1286 bytes} [Wed Aug 24 15:32:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:13.918738 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:13.926801 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011669 Aug 24 15:32:13.927371 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 33/67] 10.222.0.73 () {60 vars in 1286 bytes} [Wed Aug 24 15:32:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:13.939006 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d75a4b7d-59f3-4f22-b5d3-61b6729ca905 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:13.947694 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d75a4b7d-59f3-4f22-b5d3-61b6729ca905 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012196 Aug 24 15:32:13.948246 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1283 bytes} [Wed Aug 24 15:32:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:13.253795 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:13.254849 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 15:35:13.255243 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:35:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:13.397266 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=6 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:13.560722 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:13.563116 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:35:13.563116 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: warnings.warn(msg) Aug 24 15:35:13.564256 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:13.564762 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:13.565214 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:13.565923 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:13.566363 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:13.566806 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:13.601504 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-ae7fdabb-dc5e-4adc-a386-0ea70f8067af admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205548 Aug 24 15:35:13.601996 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 36/70] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 15:35:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:35:14.440629 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:14.441631 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 24 15:35:14.442023 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 35/71] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:35:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:14.634365 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:14.636990 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:35:14.636990 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: warnings.warn(msg) Aug 24 15:35:14.638098 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:14.638627 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:14.639161 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:14.640017 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:14.640525 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:14.641044 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:14.661641 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-c7354dca-f5fe-4615-897a-4a816c7be15d admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079717 Aug 24 15:35:14.662207 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 37/72] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 15:35:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:35:25.898664 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:25.899682 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 24 15:35:25.900077 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 36/73] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:35:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:26.045344 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:26.046058 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell1:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:26.046676 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=8 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:26.094411 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:26.096800 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:35:26.096800 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: warnings.warn(msg) Aug 24 15:35:26.097889 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:26.098358 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:26.098812 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:26.099524 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:26.099960 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:26.101009 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:26.125814 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-5768e5b9-ab85-4207-b7a5-23c455ae9151 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084926 Aug 24 15:35:26.126299 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 38/74] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 15:35:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:26.971780 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:26.972789 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-7f5016bb-5c5f-4398-ab2f-a4ccc7ce2f44 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 24 15:35:26.973190 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 37/75] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 15:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:27.170274 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:27.172730 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:35:27.172730 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: warnings.warn(msg) Aug 24 15:35:27.173812 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.174278 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.174725 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.175428 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.175867 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.176395 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.198692 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-e0f4e78c-71a1-4f1b-8d80-8ed9a9fa5296 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079331 Aug 24 15:35:27.199250 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 39/76] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 15:35:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:26.319863 dv-cinder-846054-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 15:36:26.320970 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: Wed Aug 24 15:36:26 2022 - graceful shutdown triggered... Aug 24 15:36:26.321878 dv-cinder-846054-2-iscsi devstack@n-api.service[105634]: Gracefully killing worker 1 (pid: 105634)... Aug 24 15:36:26.322243 dv-cinder-846054-2-iscsi devstack@n-api.service[105635]: Gracefully killing worker 2 (pid: 105635)... Aug 24 15:36:27.321161 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: worker 1 buried after 1 seconds Aug 24 15:36:27.321596 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: worker 2 buried after 1 seconds Aug 24 15:36:27.321596 dv-cinder-846054-2-iscsi devstack@n-api.service[105633]: goodbye to uWSGI. Aug 24 15:36:27.323330 dv-cinder-846054-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 15:36:27.323875 dv-cinder-846054-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 15:36:27.326686 dv-cinder-846054-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 15:36:27.336198 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 15:36:27.339559 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:36:27 2022] *** Aug 24 15:36:27.339734 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:36:27.339868 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: nodename: dv-cinder-846054-2-iscsi Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: machine: x86_64 Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: clock source: unix Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: pcre jit disabled Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: detected number of CPU cores: 4 Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: current working directory: / Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: your processes number limit is 47680 Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: your memory page size is 4096 bytes Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: detected max file descriptor number: 2048 Aug 24 15:36:27.340003 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: lock engine: pthread robust mutexes Aug 24 15:36:27.340756 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: thunder lock: enabled Aug 24 15:36:27.340756 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 15:36:27.340756 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:36:27.380212 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: Python main interpreter initialized at 0x55702d2d39c0 Aug 24 15:36:27.380212 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: python threads support enabled Aug 24 15:36:27.380212 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: your server socket listen backlog is limited to 100 connections Aug 24 15:36:27.380554 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:36:27.380623 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:36:27.380706 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: *** Operational MODE: preforking *** Aug 24 15:36:27.380934 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:36:27.380934 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: spawned uWSGI master process (pid: 132273) Aug 24 15:36:27.383638 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: spawned uWSGI worker 1 (pid: 132288, cores: 1) Aug 24 15:36:27.383638 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: spawned uWSGI worker 2 (pid: 132289, cores: 1) Aug 24 15:36:27.383638 dv-cinder-846054-2-iscsi devstack@n-api.service[132273]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:36:27.381156 dv-cinder-846054-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 15:36:28.068249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:36:28.080200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:36:29.262950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:36:29.262950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: from cryptography.utils import int_from_bytes Aug 24 15:36:29.263555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:36:29.263555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: from cryptography.utils import int_from_bytes Aug 24 15:36:29.288067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:36:29.288067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: from cryptography.utils import int_from_bytes Aug 24 15:36:29.288656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:36:29.288656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: from cryptography.utils import int_from_bytes Aug 24 15:36:31.735134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:36:31.735647 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:36:31.735934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:36:31.736205 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:36:31.736460 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:36:31.736851 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.737179 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.737497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.737814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.738301 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.738615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.738981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.739304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.739635 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.739896 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.740212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.740536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-2-iscsi {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.740863 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.741174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.741486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.741805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.742109 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.742431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.742765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.743267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.745432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.745432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.745432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.745432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.745818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.745901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.746151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.746473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.746814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.747123 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.747535 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-2-iscsi {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.747861 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.748180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.748476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.748910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.749230 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.749520 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.749834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.750153 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.750470 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.750815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.751137 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.751468 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.751773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.752074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.752378 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.752687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.753005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.753310 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.753617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.753867 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.754173 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.754494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.754843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.755163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.755415 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.755655 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.755972 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.756289 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.756595 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.756904 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.757208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.758056 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.758358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.758756 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.759070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.759451 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.759776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.760166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.760603 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.760915 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.761238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.761671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.761925 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.762234 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.762578 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.762946 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.763282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.763571 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.763895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.764202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.764508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.764828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.765134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.765455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.765757 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.766004 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.766303 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.766607 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.766957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.767259 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.767563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.767866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.768166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.768471 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.768775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.769078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.769383 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.769683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.769983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.770283 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.770662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.770966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.771284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.771602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.771907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.772208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.772512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.772812 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.773128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.773434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.773733 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.774055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.774355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.774675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.775055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.775493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.775891 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.776310 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.776615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.776927 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.777247 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.777555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.777860 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.778163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.778469 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.778797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.779103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.779400 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.779710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.780012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.780329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.780650 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.780983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.781317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.781616 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.781965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.782122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:36:31.782606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:36:31.782807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.782807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.783105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:36:31.783252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.783407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:36:31.783577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.783722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:36:31.783868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.784014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.784187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.784350 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.784496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.784640 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.784796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.784941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.785095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.785250 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.785403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.785578 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.785725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.785878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.786038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.786038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.786322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.786475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.786628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.786628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.786980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.787133 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.787279 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.787433 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846054-2-iscsi {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.787588 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.787734 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.787892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.788037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.788403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.788576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.788732 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.788924 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.789268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.789419 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.789567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.789718 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.789879 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.790038 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.790192 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.790192 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.791097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.791270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.791470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.791619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.791772 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.791918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.792065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.792065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.792353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.792556 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.792704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.792848 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.793001 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.793153 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.793313 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.794016 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.794181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.794329 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.794482 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.794670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.794837 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.794991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846054-2-iscsi {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.795145 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.795291 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.795435 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.795593 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.795739 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.795886 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.796051 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.796051 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.796347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.796501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.796646 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.796799 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.796954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.797106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.797266 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.797419 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.797583 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.797740 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.797909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.798055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.798214 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.798521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.798701 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.798862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.799035 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.799476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.799630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.799784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.799938 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.800085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.800242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.800409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.800555 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.800707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.800861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.801007 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.801196 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.801360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.801507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.801659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.801816 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.801969 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.802123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.802283 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.802439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.802584 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.802806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.802955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.803114 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.803264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.803416 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.803416 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.803827 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.803984 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.804140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.804140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.804445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.804600 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.804752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.804982 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.805137 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.805137 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.805420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.805565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.805717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.805717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.806017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.806017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.806956 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.807201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.807472 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.807472 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.807801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.807963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.808110 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.808262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.808417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.808744 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.808895 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.809095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.809261 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.809733 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.809905 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.810059 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.810213 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.810366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.810521 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.810699 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.810867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.811013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.811216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.811216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.811506 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.811506 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.811817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.812010 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.812157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.812309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.812454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.812599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.812762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.812924 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.813070 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.813214 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.813367 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.813519 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.813686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.814513 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.814710 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.814874 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.815021 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.815175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.815329 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.815489 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.815642 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.815789 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.815935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.816080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.816239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.816397 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.816549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.816695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.816848 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.817001 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.817164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.817372 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.817540 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.817687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.817834 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.817986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.818148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.818301 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.818457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.818613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.818946 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.819111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.819272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.819418 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.819882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.819882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.820176 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.820355 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.821082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.821296 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.821450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.821608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.821825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.822062 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.822227 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.822374 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.822519 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.822697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.822850 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.823014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.823162 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.823306 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.823461 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.823626 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.823626 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.823922 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.824084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.824238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.824393 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.824567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.824820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.824970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.825116 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.825261 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.825417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.825563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.825738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.825895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.826049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.826206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.826360 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.826512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.826736 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.826901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.827055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.827210 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.827357 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.827512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.827665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.827829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.827975 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.828136 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.828283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.828436 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.828582 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.828726 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.828898 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.829213 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.829370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.829527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.830019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.830194 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.830360 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.830521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.830688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.830840 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.830985 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.831140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.831296 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.831494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.831639 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.831792 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.831939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.832091 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.832252 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.832409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.832563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:36:31.832717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.832862 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.833015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.833170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.833324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.833470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.833623 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.833777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.833930 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.834085 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.834346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.834520 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.834748 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.835012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.835251 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.835406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.835553 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.835699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.835843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.835996 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.836229 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.836402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.836550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.836720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.836866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.837019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.837174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.837358 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.837539 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.837941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.838199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.838385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.838540 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.838717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.838877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.839041 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.839342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.839510 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.839665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.839810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.840273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.840273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.840563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.840725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.840873 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.841018 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.841163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.841307 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.841505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.841671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.841817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.841964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.842117 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.842263 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.842419 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.842574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.842756 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.842911 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.843059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.843203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.843362 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.843526 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.843673 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.843825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.843979 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.844132 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.844291 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.844443 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.844596 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.844741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.844893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.845149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.845312 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.845459 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.845623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.845769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.845922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.846077 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.846233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.846379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.846379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.846695 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.846847 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.847011 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.847169 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.847315 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.847460 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.847614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.847768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.847928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.848095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.848816 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.848973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.849122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.849437 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.849603 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.849758 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.849904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.850069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.850565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.850870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.851034 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.851430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.851629 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.851779 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.851925 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.852103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.852258 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.852423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.852571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.852571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.852845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.853545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.853694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.853865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.854085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.854234 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.854388 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.854548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.854722 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.854874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.855026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.855180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.855325 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.855479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.855649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.855822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.856064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.856214 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.856370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.856515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.856660 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.856814 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.856980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.857133 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.857292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.857443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.857594 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.857757 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.857918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.858078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.858239 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.858392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.858543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.858779 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.858940 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.859092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.859242 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.859420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.859721 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.859896 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.860057 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.860228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.860649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.860844 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.861067 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.861232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.861395 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.861548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.861751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.861751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.862047 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.862212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.862383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.862543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.862730 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.862931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.863101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.863262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.863414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.863565 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.863724 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.863875 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.864043 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.864202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.864362 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.864533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.864685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.864837 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.865004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.865164 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.865356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.865521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.865681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.865841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.866003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.866277 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.866453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.866617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.866806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.867041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.867197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.867356 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.867508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.867666 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.867825 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.867988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.868142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.868302 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.868454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.868722 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.868940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.869151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.869447 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.869765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.869927 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.870981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.871229 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.871409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.871578 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.871776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.871935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.872087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.872087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.872412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.872573 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.872738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.872838 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.872921 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873085 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873607 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.873985 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874345 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874522 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874839 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.874935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875287 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875466 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875551 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875719 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875813 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875900 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.875984 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876067 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876244 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876524 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876623 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876889 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.876980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877158 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877244 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877343 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877437 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877530 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877616 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877814 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.877909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878367 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878551 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878779 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.878894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879333 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879505 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.879912 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880108 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880221 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.880479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.881402 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.881490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.881490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.881490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.881490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.881490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.881490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.882857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883168 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.883763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.884071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.884671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.884671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.884671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.884671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.884671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.884671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.885151 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.885223 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.885321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.885706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.885800 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.886030 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.886347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.886447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.886793 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.886975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.887080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.887318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.887580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.887683 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.887932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.888181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.888276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.888540 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.888789 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.888907 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.889161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.889411 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.889744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.890001 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.890106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.890385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.890479 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.890742 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.891053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.891175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.891379 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.891671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.891774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.892035 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.892282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.892378 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.892666 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.892920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.893017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.893274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.893529 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.893624 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.893882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.894541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.894668 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.894771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.894874 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.894963 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.895114 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.895368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.895470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.895717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.895961 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.896056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.896317 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.896564 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.896658 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.896930 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.897243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.897551 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.897652 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.897877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.898180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.898284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.898487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.898802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.898913 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.899117 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.899421 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.899553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.899760 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.900576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.900954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.901198 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.901306 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.901621 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.902778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.902778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.902939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903182 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903182 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903182 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903458 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903712 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.903879 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.904071 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.904370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.904511 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.904683 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.904898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.905055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.905295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.905434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.905613 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.905871 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.906027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.906216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.906386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.906526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.906853 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.907083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.907241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.907382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.907535 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.907752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.908031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.908174 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.908359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.908555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.908706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.908964 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.909143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.909285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.909533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.909684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.909866 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.910013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.910164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.910465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.910822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.910973 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.911127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.911383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.911383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.911561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.911740 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.912024 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.912138 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.912334 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.912643 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.912854 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.912959 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.913252 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.913444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.913560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.913873 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.914125 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.914228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.914505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.914747 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.914859 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.915139 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.915353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.915498 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.915919 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.916131 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.916447 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.916653 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.916924 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.917187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.917407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.917705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.917941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.918216 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.918491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.918794 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.918920 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.919247 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.919635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.919895 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.920216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.920522 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.920771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.921174 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.921535 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.924631 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.924631 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.924892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.925001 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.925189 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.925347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.925493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.925493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.925771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.925771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.926033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.926403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.926840 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.927304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.928130 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.928130 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.928539 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.928938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.929346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.929759 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.930156 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.930570 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.931231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.931741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.932187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.932836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.933142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.933589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.933751 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.934068 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.934214 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.934555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.935113 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.935560 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.936095 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.936337 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.936513 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.936792 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.936934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.937123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.937341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.937448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.937798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.937913 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.938130 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.938421 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.938516 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.938816 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.939045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.939148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.939485 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.939623 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.939807 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.940169 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.940289 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.940454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.940755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.940855 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.941090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.941356 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.941477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.941994 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.942112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.942209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.942347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.942532 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.942689 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.943014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.943409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.943514 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.943603 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.943706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.943935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.944207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.944301 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.944574 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.944773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.944891 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.945198 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.945316 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.945541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.945676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.945820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.946127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.946396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.946492 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.947432 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.947590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.947756 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.947853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.948102 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.948203 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.948445 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.948553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.948776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.948878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.949100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.949202 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.949420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.949521 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.949738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.949831 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.950052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.950151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.950406 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.950518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.950762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.950859 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.951183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.951289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.951438 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.951557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.951755 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.951877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.952066 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.952160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.952386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.952480 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.952720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.952821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.953033 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.953149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.953342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.953436 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.953653 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.953754 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.953984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.954092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.954293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.954387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.954623 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.954738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.954985 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.955094 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.955323 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.955416 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.955646 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.955764 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.955958 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.956065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.956268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.956378 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.956577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.956680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.956907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.957005 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.957222 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.957386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.957553 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.957717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.957887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.958031 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.958172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.958353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.958487 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.958692 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.958826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.959025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.959180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.959359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.959494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.959676 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.959832 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.959997 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.960149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.960306 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.960487 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.960644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.960814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.960973 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.961140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.961298 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.961466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.961633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.961793 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.962058 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.962154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.962481 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.962596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.962880 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.962985 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.963213 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.963316 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.963548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.963650 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.963860 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.963962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.964171 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.964272 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.964487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.964754 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.964849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.965091 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.965193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.965418 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.965519 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.965743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.965850 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.966686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.966803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.966886 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.966975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.967063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.967146 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.967220 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.967299 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.967380 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.967453 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.967923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968036 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968121 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968275 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968672 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968855 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.968934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.969191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.969295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.969477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.969743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.969934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.970098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.970256 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.970423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.970581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.970805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.970895 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.971121 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.971231 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.971426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.971519 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.971718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.971816 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.972040 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.972165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.972381 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.972510 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.972767 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.972867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.973057 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.973152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.973303 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.973485 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.973623 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.973818 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.973925 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.974149 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.974253 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.974475 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.974583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.974909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.975020 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.975258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.975362 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.975548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.975631 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.975992 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.976103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.976443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.976524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.976727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.976822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.977036 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.977131 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.977349 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.977444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.977659 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.978389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.978606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.978796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.978953 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.979116 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.979270 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.979430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.979597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.979775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.980007 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.980175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.980328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.980491 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.980668 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.980820 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.980972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.981122 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.981280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.981442 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.981603 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.981755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.981914 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.982066 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.982235 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.982396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.982557 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.982755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.983005 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.983172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.983332 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.983495 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.983647 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.983798 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.983949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.984131 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.984287 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.984287 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.984596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.984748 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.984907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.985059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.985258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.985426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.985587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.985740 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.985901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.986061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.986222 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.986388 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.986550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.986550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.986866 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.987028 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.987190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.987343 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.987493 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.987651 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.987810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.987972 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.988124 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.988283 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.988453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.988611 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.988764 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.988979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.989139 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.989292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.989451 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.989602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.989753 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.989918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.990098 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.990258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.990409 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.990571 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.990803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.990970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.991123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.991284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.991436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.991594 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.991755 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.991909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.992067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.992218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.992369 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.992537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.992709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.992866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.993041 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.993279 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.993445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.993670 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.993826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.993986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.994138 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.994289 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.994448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.994625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.994804 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.994966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.995127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.995285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.995437 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.995601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.995752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.995904 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.996056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.996215 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.996374 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.996539 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.996711 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.996711 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.997006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.997159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.997324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.997476 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.997626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.997777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.997935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.998087 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.998247 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.998407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.998569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.998821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.998975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.999126 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.999290 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.999449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.999600 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.999753 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:31.999911 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.000063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.000228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.000717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.000880 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.001048 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.001199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.001365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.001525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.001684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.001845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.001997 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.002156 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.002321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.002481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.002634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.002827 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.002988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.003159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.003414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.003576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.003729 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.003888 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.004040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.004206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.004365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.004525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.004685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.004844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.005004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.005185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.005338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.005497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.005497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.005787 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.005945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.006107 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.006259 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.006410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.006570 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.006762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.006916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.007084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.007248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.007407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.007558 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.007709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.007870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.008036 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.008188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.008339 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.008490 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.008641 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.008806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.008958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.009118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.009835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.009990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.010152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.010318 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.010470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.010629 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.010808 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.010961 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.011125 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.011125 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.011430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.011584 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.011755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.011909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.012073 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.012225 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.012375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.012527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.012692 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.012857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.013021 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.013181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.013333 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.013573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.013746 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.013899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.014059 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.014211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.014211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.014512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.014729 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.014901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.015062 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.015222 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.015376 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.015534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.015686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.015861 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.016026 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.016178 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.016337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.016497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.016650 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.016810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.016962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.017124 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.017289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.017441 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.017605 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.017757 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.017928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.018081 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.018239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.018397 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.018561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.018758 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.018929 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.019085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.019249 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.019401 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.019634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.019788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.019958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.020110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.020262 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.020414 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.020574 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.020726 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.020726 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.021029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.021181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.021342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.021494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.021647 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.021797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.021966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.022117 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.022117 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.022775 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.022930 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.023082 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.023233 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.023641 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.023815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.023978 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.024130 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.024280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.024432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.024594 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.024775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.025000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.025652 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.025804 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.025955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.026121 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.026121 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.026416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.026576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.026783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.026937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.027118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.027279 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.027438 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.027591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.027741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.027893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.028056 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.028208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.028208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.028503 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.028661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.028826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.028986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.029148 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.029300 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.029450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.029602 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.029762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.029922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.030081 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.030240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.030393 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.030552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.030739 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.030898 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.031060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.031219 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.031370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.031527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.031687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.031841 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.031991 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.032142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.032292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.032452 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.032617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.032774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.032935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.033097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.033248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.033409 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.033568 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.033727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.033880 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.034030 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.034188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.034350 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.034501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.034677 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.034836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.035009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.035171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.035322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.035474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.035633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.035792 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.035952 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.036116 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.036276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.036458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.036637 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.036812 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.036978 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.037145 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.037145 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.037449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.037600 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.037751 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.037914 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.038074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.038227 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.038384 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.038535 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.038719 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.038894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.039067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.039067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.039363 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.039521 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.039680 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.039846 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.039998 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.040158 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.040309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.040486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.040649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.040809 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.040968 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.041138 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.041291 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.041441 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.041601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.041760 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.041919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042230 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.042382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.043573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.043573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.043573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.043573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.043573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.044292 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.044292 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.044576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.044784 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.045100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.045427 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.045739 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.046065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.046391 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.046736 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.047051 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.047387 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.047699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.048012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.048327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.048638 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.048949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.049260 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.049589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.049918 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.050227 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.050558 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.050991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.051313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.051632 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.051945 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.052280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.052589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.052902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.053217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.053526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.053838 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.054162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.054474 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.054813 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.055131 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.055449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.055777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.056130 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.056444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.056772 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.057104 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.057451 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.057765 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.058114 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.058448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.058792 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.059109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.059420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:36:32.059664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:36:32.103439 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO dbcounter [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Registered counter for database nova_api Aug 24 15:36:32.123193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO dbcounter [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Registered counter for database nova_api Aug 24 15:36:32.124874 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_db.sqlalchemy.engines [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.131782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writer thread running {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.144009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_db.sqlalchemy.engines [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.150817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writer thread running {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.189465 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.context [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d7efa9e-3929-4bb8-bb7f-bcfc584eee15(cell1) {{(pid=132288) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:36:32.193536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:32.194015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:32.195657 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:32.196435 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:32.197565 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:32.199602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:32.201616 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO dbcounter [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Registered counter for database nova_cell0 Aug 24 15:36:32.206065 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO dbcounter [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Registered counter for database nova_cell1 Aug 24 15:36:32.207517 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.context [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d7efa9e-3929-4bb8-bb7f-bcfc584eee15(cell1) {{(pid=132289) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:36:32.211579 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:32.212060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:32.213420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_db.sqlalchemy.engines [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.214083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:32.214898 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:32.215351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:32.216652 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_db.sqlalchemy.engines [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.217396 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:32.219463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO dbcounter [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Registered counter for database nova_cell0 Aug 24 15:36:32.220079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writer thread running {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.223515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO dbcounter [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Registered counter for database nova_cell1 Aug 24 15:36:32.230923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_db.sqlalchemy.engines [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.232665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_db.sqlalchemy.engines [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.238698 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writer thread running {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.240744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writer thread running {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.364933 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writer thread running {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.375046 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO dbcounter [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Registered counter for database nova_cell0 Aug 24 15:36:32.381761 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_db.sqlalchemy.engines [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.386970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writer thread running {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.388928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO dbcounter [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Registered counter for database nova_cell0 Aug 24 15:36:32.397859 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_db.sqlalchemy.engines [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:36:32.403557 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writer thread running {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:36:32.713901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: WARNING keystonemiddleware.auth_token [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:36:32.721366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: WARNING keystonemiddleware.auth_token [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:36:32.726877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: WARNING keystonemiddleware.auth_token [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:36:32.734310 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: WARNING keystonemiddleware.auth_token [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:36:33.075561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: WARNING keystonemiddleware.auth_token [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:36:33.082102 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: WARNING keystonemiddleware.auth_token [None req-962fe4c4-f7d4-47d3-b772-a42217837939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:36:33.082465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: WARNING keystonemiddleware.auth_token [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:36:33.088628 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55702d2d39c0 pid: 132288 (default app) Aug 24 15:36:33.089749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: WARNING keystonemiddleware.auth_token [None req-3412f6d6-88ca-45c9-9cab-755088ff281f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:36:33.095128 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55702d2d39c0 pid: 132289 (default app) Aug 24 15:37:12.753951 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b19bc396-5944-43e6-bc40-d0271a7afa17 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791fb2430>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:12.842409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:12.842409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:12.842409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:12.842409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:13.429754 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b19bc396-5944-43e6-bc40-d0271a7afa17 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d681a24c-c1a8-43b0-814f-27d05d24f3bf" status: 200 len: 351 microversion: 2.1 time: 1.252448 Aug 24 15:37:13.431305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 1/1] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:37:12 2022] GET /compute/v2.1/os-volumes/d681a24c-c1a8-43b0-814f-27d05d24f3bf => generated 351 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:15.596774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=3 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:15.598705 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=3 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:15.603616 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=3 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:15.604578 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=3 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:16.010885 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6c1f1331-3afa-4554-93e3-569b81dff668 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791ece430>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:16.759303 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6c1f1331-3afa-4554-93e3-569b81dff668 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0188de98-f8ee-479c-baef-7e84807d186d" status: 200 len: 351 microversion: 2.1 time: 1.168248 Aug 24 15:37:16.768252 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 1/2] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:37:15 2022] GET /compute/v2.1/os-volumes/0188de98-f8ee-479c-baef-7e84807d186d => generated 351 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:18.861377 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-205f7f6e-303a-413d-ae6c-75e53cd55660 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d8f700>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:19.010272 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-205f7f6e-303a-413d-ae6c-75e53cd55660 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/39c5abeb-437d-43cb-b4e3-e20a25465a3e" status: 200 len: 351 microversion: 2.1 time: 0.152946 Aug 24 15:37:19.011858 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:37:18 2022] GET /compute/v2.1/os-volumes/39c5abeb-437d-43cb-b4e3-e20a25465a3e => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:19.038355 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-71106289-5166-45c6-8c44-eea806e96be8 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d93670>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:19.303072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-71106289-5166-45c6-8c44-eea806e96be8 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.275381 Aug 24 15:37:19.304327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1134 bytes} [Wed Aug 24 15:37:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:19.344811 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b5e31d53-5698-48ec-99de-08523c5025d1 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d8f940>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:19.563430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b5e31d53-5698-48ec-99de-08523c5025d1 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.246661 Aug 24 15:37:19.564061 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 3/5] 10.222.0.73 () {58 vars in 1149 bytes} [Wed Aug 24 15:37:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:19.578015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f61156cb-f6c9-457b-9c1f-3fcc8cc7faef tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d93940>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:19.755707 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f61156cb-f6c9-457b-9c1f-3fcc8cc7faef tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.181471 Aug 24 15:37:19.756998 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 3/6] 10.222.0.73 () {58 vars in 1134 bytes} [Wed Aug 24 15:37:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:19.770445 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1205ef64-e070-4f04-96b5-64864348087c tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d8fe50>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:19.960083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1205ef64-e070-4f04-96b5-64864348087c tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.194125 Aug 24 15:37:19.960710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1167 bytes} [Wed Aug 24 15:37:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:37:19.977228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f88e2fba-fc3f-4deb-92f3-c2511b607fb5 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d62c10>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:20.224648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f88e2fba-fc3f-4deb-92f3-c2511b607fb5 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.253585 Aug 24 15:37:20.225347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1170 bytes} [Wed Aug 24 15:37:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:20.246593 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-603a0624-2520-49e5-84f9-6bb58988b9ad tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d6a9d0>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:20.548301 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-603a0624-2520-49e5-84f9-6bb58988b9ad tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.308015 Aug 24 15:37:20.549383 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 5/9] 10.222.0.73 () {58 vars in 1155 bytes} [Wed Aug 24 15:37:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:20.573694 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-aea57d9b-a4c9-4279-8a58-32e559f9b674 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d62820>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:20.799871 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-aea57d9b-a4c9-4279-8a58-32e559f9b674 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.238541 Aug 24 15:37:20.801059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 5/10] 10.222.0.73 () {58 vars in 1188 bytes} [Wed Aug 24 15:37:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:20.813698 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c190bb6e-3727-46fc-b05b-c9b561a4f752 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] Calling method '.version_select at 0x7f0791d6ec10>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:21.018308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c190bb6e-3727-46fc-b05b-c9b561a4f752 tempest-VolumesTestJSON-2108552483 tempest-VolumesTestJSON-2108552483-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.207967 Aug 24 15:37:21.020286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 6/11] 10.222.0.73 () {58 vars in 1155 bytes} [Wed Aug 24 15:37:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:24.134789 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1746879705", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "networks": [{"uuid": "c2f710af-a064-4b7b-b43a-23e3b653ca60"}]}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:24.440272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] validate_networks() for [('c2f710af-a064-4b7b-b43a-23e3b653ca60', None, None, None, None, None)] {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:37:26.879291 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6728abf5-7424-4037-b69d-e50ceb40da9d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'create', calling method: .version_select at 0x7f079272a700>, body: {"keypair": {"name": "tempest-keypair-438778067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVrEGKym3XAsHL6a8ej0Az0SkVAVn2z14DV3HAljI9AlasVrzSCZmVbJy1s9YYEiYmZwBgqIydyF5FHLsB3W1EF7ps8M3fhNedW+4t9kwLB/UxufW8owSmaRj+aCSTu0A=="}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:26.983230 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-6728abf5-7424-4037-b69d-e50ceb40da9d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:26.995889 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-6728abf5-7424-4037-b69d-e50ceb40da9d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for user f28236459bb9492eaa35690f121d4e3c and project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:27.099705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6728abf5-7424-4037-b69d-e50ceb40da9d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.461776 Aug 24 15:37:27.101481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 7/12] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:37:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:27.826494 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:37:27.827356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:37:27.827428 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:37:27.827806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:37:27.828233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:37:27.856356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:27.856847 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:27.857277 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:27.858164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:27.858802 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:27.859366 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:27.942303 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Getting quotas for project ee9eb7c5b5f94cd78546a3c1cc3d7cc7. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:27.960356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Getting quotas for user b490535729c64eaa8e89bf8eb8d56290 and project ee9eb7c5b5f94cd78546a3c1cc3d7cc7. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:27.994153 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:37:27.997258 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:37:28.147100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ac682090-45d6-4caa-9f94-ee641beb0f3f tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.997230 Aug 24 15:37:28.148475 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 6/13] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:37:28.161602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f2b4115f-56d9-4924-b044-9cb32254d4b3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:28.162385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f2b4115f-56d9-4924-b044-9cb32254d4b3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:28.405612 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f2b4115f-56d9-4924-b044-9cb32254d4b3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:28.426077 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f2b4115f-56d9-4924-b044-9cb32254d4b3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1215 microversion: 2.1 time: 0.269314 Aug 24 15:37:28.440026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 8/14] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:28 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:29.447477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-41359aea-855a-4263-9301-6f81e9fcb9e3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:29.448874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-41359aea-855a-4263-9301-6f81e9fcb9e3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:29.641136 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-41359aea-855a-4263-9301-6f81e9fcb9e3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:29.703343 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-41359aea-855a-4263-9301-6f81e9fcb9e3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1215 microversion: 2.1 time: 0.245323 Aug 24 15:37:29.721511 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 7/15] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:29 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1215 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:30.900027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-364877950", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:31.021647 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] validate_networks() for [('eb9d3cc4-b6ec-44e7-98b4-28d29d6a6c5a', None, None, None, None, None)] {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:37:31.176621 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b9099013-2c15-4ea3-93c9-d59a070b3094 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: .version_select at 0x7f0791486ca0>, body: {"keypair": {"name": "tempest-keypair-1880189419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuXz6mNdt9MU0BIHGCakcEg58O453sNLtptRR5MpgxOBtyxDORmVXq/XVDW82MtybbVij4+g67Rty55PTmq0ee9EGHTintRoDYNuOY0Ygv97sQTktg/fwJ4QqEw5y+9ow=="}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:31.224183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-b9099013-2c15-4ea3-93c9-d59a070b3094 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:31.239796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-b9099013-2c15-4ea3-93c9-d59a070b3094 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:31.291554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b9099013-2c15-4ea3-93c9-d59a070b3094 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.226250 Aug 24 15:37:31.292572 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 9/16] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:37:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:31.306873 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:31.309047 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:31.322026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:31.329874 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:31.330851 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:31.335261 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:31.336829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:31.338354 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:31.860048 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:31.889386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-550ae07b-06e4-403d-a64b-8d97cb25c1ee tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1267 microversion: 2.1 time: 0.593543 Aug 24 15:37:31.901483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 10/17] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:31 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1267 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:32.935367 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:32.940635 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:32.969152 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:32.973117 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:32.973862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:32.975078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:32.975646 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:32.976251 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:33.367811 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:33.385964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-deca2928-4de1-47c3-9ba1-80661fbf89b1 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1273 microversion: 2.1 time: 0.467505 Aug 24 15:37:33.402152 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 11/18] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:32 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1273 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:33.572999 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:37:33.573909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:37:33.574675 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:37:33.582635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:37:33.583296 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:37:33.604563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:33.606590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:33.607693 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:33.611431 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:33.612172 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:33.615742 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:33.667684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for project 3d204b26857042e397b91be285fa3ed9. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:33.688722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for user 4dd615d7af7741b08cc44b6c983fae49 and project 3d204b26857042e397b91be285fa3ed9. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:33.713054 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:37:33.715803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:37:33.840224 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-51378c6b-80ec-46a6-8949-d40c256ca9c0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.768809 Aug 24 15:37:33.843019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 8/19] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:37:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:37:33.855841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4de78e8b-26cf-4fc2-b2df-a29d70d95b58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:33.856473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4de78e8b-26cf-4fc2-b2df-a29d70d95b58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:34.014012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4de78e8b-26cf-4fc2-b2df-a29d70d95b58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:34.040622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4de78e8b-26cf-4fc2-b2df-a29d70d95b58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1221 microversion: 2.1 time: 0.188670 Aug 24 15:37:34.042545 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 12/20] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:33 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:34.411339 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:34.411966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:34.422124 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:34.426091 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:34.428618 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:34.429581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:34.430543 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:34.432439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:34.512793 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1827755166", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4edf337-5391-4629-bda7-d1122fcdfc2b"}], "security_groups": [{"name": "tempest-securitygroup--1932763481"}], "key_name": "tempest-keypair-438778067", "user_data": "}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:35.177554 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:35.221221 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-495a91d4-e7ee-4c02-8029-51b060c56f25 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1273 microversion: 2.1 time: 0.815573 Aug 24 15:37:35.230831 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 9/21] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:34 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1273 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:35.247947 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-208688905", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:35.256781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] validate_networks() for [('a4edf337-5391-4629-bda7-d1122fcdfc2b', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:37:35.371009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] validate_networks() for [('eb9d3cc4-b6ec-44e7-98b4-28d29d6a6c5a', None, None, None, None, None)] {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:37:39.645708 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:37:39.646317 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:37:39.646698 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:37:39.647239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:37:39.647719 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:37:39.664904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:39.665394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:39.666691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:39.670069 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:39.672827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:39.673989 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:39.725218 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for project 3d204b26857042e397b91be285fa3ed9. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:39.736826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for user 4dd615d7af7741b08cc44b6c983fae49 and project 3d204b26857042e397b91be285fa3ed9. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:39.782318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:37:39.791117 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:37:39.926426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-39b946c2-67ae-4d03-80d1-b5d9087266b6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.694076 Aug 24 15:37:39.934763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 10/22] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:37:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 4703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:37:39.947186 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:39.947855 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:39.973216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:39.973926 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:39.974518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:39.975548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:39.977375 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:39.977995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:40.824365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:40.836915 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4b1c221b-6418-4ba3-92c7-8efb4a62bcf8 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.900965 Aug 24 15:37:40.837548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 11/23] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:39 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:40.885801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-615660725", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105210c5-8b78-4e8c-bd12-9456d560212d"}], "security_groups": [{"name": "tempest-securitygroup--1667116495"}], "key_name": "tempest-keypair-1880189419", "user_data": "}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:41.653273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:37:41.654225 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:37:41.655292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:37:41.656362 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:37:41.657401 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:37:41.702430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:41.711611 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:41.712447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:41.715612 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:41.718554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:41.720693 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:41.835997 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:41.859943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for user f28236459bb9492eaa35690f121d4e3c and project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:41.901668 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:37:41.905360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:37:42.074366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5bf02cb4-7d10-41f8-b41c-4192374651ad tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.566920 Aug 24 15:37:42.075442 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 13/24] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:37:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 7569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:37:42.084368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:42.085064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:42.108851 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.126583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.127195 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.128204 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.128808 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.129268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.350332 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] validate_networks() for [('105210c5-8b78-4e8c-bd12-9456d560212d', None, None, None, None, None)] {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:37:43.197943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:43.214068 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3fb90bef-6684-4ebd-9f1e-f4d213d29e63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1273 microversion: 2.1 time: 1.135487 Aug 24 15:37:43.216065 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 14/25] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:42 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1273 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:43.243669 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:43.248039 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:43.277435 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:43.278282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:43.281655 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:43.285821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:43.288160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:43.289267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:43.929271 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:43.942000 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-595545d2-cacd-44ff-a7c4-1e349a6c59f9 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.721469 Aug 24 15:37:43.944819 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 15/26] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:43 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:43.958587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:43.959557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:43.975006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:43.975515 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:43.975950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:43.984539 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:43.985351 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:43.986066 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:44.430620 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:44.438497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f337e671-8220-4c01-962e-65aec5c49b6c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1289 microversion: 2.1 time: 0.489824 Aug 24 15:37:44.469476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 16/27] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:43 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1289 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:45.055757 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-b91c6ead-d4c3-4387-8ca8-92837580d803 req-b22a32e9-4085-427d-9273-4fe42febc805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b68fc0-0cf5-4107-826c-b811fd855918", "tag": "4bf86c74-fa64-4d0d-8726-16e4fd8bc9d0"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:45.089296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-b91c6ead-d4c3-4387-8ca8-92837580d803 req-b22a32e9-4085-427d-9273-4fe42febc805 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.090362 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-b91c6ead-d4c3-4387-8ca8-92837580d803 req-b22a32e9-4085-427d-9273-4fe42febc805 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.091688 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-b91c6ead-d4c3-4387-8ca8-92837580d803 req-b22a32e9-4085-427d-9273-4fe42febc805 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.139962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-b91c6ead-d4c3-4387-8ca8-92837580d803 req-b22a32e9-4085-427d-9273-4fe42febc805 service nova] Creating event network-changed:4bf86c74-fa64-4d0d-8726-16e4fd8bc9d0 for instance 97b68fc0-0cf5-4107-826c-b811fd855918 on hv-cinder-84605 Aug 24 15:37:45.153685 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-b91c6ead-d4c3-4387-8ca8-92837580d803 req-b22a32e9-4085-427d-9273-4fe42febc805 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 15:37:45.154811 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-b91c6ead-d4c3-4387-8ca8-92837580d803 req-b22a32e9-4085-427d-9273-4fe42febc805 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 15:37:45.156437 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.157131 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.157797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.159116 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.160085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.160728 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.195441 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.compute.rpcapi [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 15:37:45.196677 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] Releasing lock "compute-rpcapi-router" {{(pid=132288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 15:37:45.238961 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-453d9d00-6537-4188-ad6a-5f2640a72692 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.766516 Aug 24 15:37:45.239822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 17/28] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:45.245775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:45.246816 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:45.256602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.257249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.257964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.258841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.259524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.260175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.302049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:37:45.303389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:37:45.303876 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:37:45.304333 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:37:45.305084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:37:45.339181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.339900 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.340589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.341560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.348986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.349707 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.421078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:45.433280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:45.445877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:45.459479 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-41e1e4db-7309-4349-b51c-484f29dff9f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1279 microversion: 2.1 time: 0.217997 Aug 24 15:37:45.460259 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 18/29] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:45 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:45.476118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:45.476826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:45.481035 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:37:45.483885 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:37:45.488200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.488846 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.491114 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.491964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.492642 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.494993 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.589408 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7e12f930-d25c-426e-972a-4e56fb386dc9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.736644 Aug 24 15:37:45.601006 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 12/30] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:37:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 4749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:37:45.606462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:45.613867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:45.631342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.633427 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.634055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.634998 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.640027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.642069 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.800544 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:45.815158 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0214b293-19bb-43be-a96e-39b71a6b22a2 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1295 microversion: 2.1 time: 0.210125 Aug 24 15:37:45.833109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 13/31] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:45 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1295 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:45.842770 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a80af4a0-61a8-4a0b-89b9-9bf75039c61a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:45.849085 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a80af4a0-61a8-4a0b-89b9-9bf75039c61a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:45.999379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:46.039439 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-279409b2-b47a-4d00-8ede-16aeb1b62330 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.577924 Aug 24 15:37:46.044002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 19/32] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:45 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:46.244453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a80af4a0-61a8-4a0b-89b9-9bf75039c61a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:46.255337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a80af4a0-61a8-4a0b-89b9-9bf75039c61a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1241 microversion: 2.1 time: 0.420790 Aug 24 15:37:46.256330 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 14/33] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:45 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1241 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:46.484200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:46.484879 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:46.487505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=12 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:46.501431 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:46.502150 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:46.511450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:46.512483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:46.513479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:46.514084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:46.690199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-cbe80fb0-686a-445f-879e-d0c536257bdd req-985db0ab-48a4-433b-882a-ccdf4235058d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9197f87-6b4b-48c3-82b6-291e3fa22b44", "tag": "d16aa60b-75fe-494c-ab0b-80320b598060"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:46.708691 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-cbe80fb0-686a-445f-879e-d0c536257bdd req-985db0ab-48a4-433b-882a-ccdf4235058d service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:46.719485 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-cbe80fb0-686a-445f-879e-d0c536257bdd req-985db0ab-48a4-433b-882a-ccdf4235058d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:46.720247 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-cbe80fb0-686a-445f-879e-d0c536257bdd req-985db0ab-48a4-433b-882a-ccdf4235058d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:46.735148 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-cbe80fb0-686a-445f-879e-d0c536257bdd req-985db0ab-48a4-433b-882a-ccdf4235058d service nova] Creating event network-changed:d16aa60b-75fe-494c-ab0b-80320b598060 for instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 on hv-cinder-84605 Aug 24 15:37:46.748035 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-cbe80fb0-686a-445f-879e-d0c536257bdd req-985db0ab-48a4-433b-882a-ccdf4235058d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373385 Aug 24 15:37:46.754460 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 20/34] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:46.829309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:46.840177 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:46.841180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:46.847773 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-aff252be-2a83-4d89-8982-3f0479aebe5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1279 microversion: 2.1 time: 0.367749 Aug 24 15:37:46.852924 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:46.857120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 15/35] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:46 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:37:46.862906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:46.863966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:46.866465 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:46.879527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:46.887379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.013988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:47.032249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-bda10513-17e3-46be-a702-836594904177 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1295 microversion: 2.1 time: 0.196026 Aug 24 15:37:47.059134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 21/36] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:46 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1295 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:37:47.069160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:47.070904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:47.081909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.097655 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.098492 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.099426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.100081 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.105464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.288691 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:47.289461 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:47.305038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.306057 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.307637 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.308570 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.310263 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.311113 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.537360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:47.551798 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-81acd5e2-f609-4283-a179-86c23068d584 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1293 microversion: 2.1 time: 0.277847 Aug 24 15:37:47.552424 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 22/37] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:47 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:47.567001 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:47.572080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-48d330ec-2cbb-42de-b2f6-b6605310ccad tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.504736 Aug 24 15:37:47.603762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 16/38] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:47 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:47.878930 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:47.879762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:47.899015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.900254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.903141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.906358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.908026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.910785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.057533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:48.058210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:48.065510 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.066078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.066537 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.075558 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.076338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.077563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.890705 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:48.904808 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-fa91bcb1-5c5e-4b55-adde-3bb59f543db5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1295 microversion: 2.1 time: 0.851081 Aug 24 15:37:48.910232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 17/39] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:48 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1295 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:48.916726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:48.917820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:48.946205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.947203 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.948704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.949791 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.950530 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.953118 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:49.013499 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:49.044075 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f70c29af-5d54-410c-881a-d3491408d4ce tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 1.170633 Aug 24 15:37:49.044687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 23/40] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:47 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:49.058126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:49.062202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:49.091921 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:49.093548 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:49.094687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:49.097998 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:49.100950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:49.102270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:49.160273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:49.177902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-31bc61b4-c79d-4ffa-9af8-9e3f4d7095d8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1299 microversion: 2.1 time: 0.261281 Aug 24 15:37:49.179872 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 18/41] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:48 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1299 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:49.491738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:49.519145 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-232646a8-57d0-4228-bd52-bbd9adb5d91b tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.473081 Aug 24 15:37:49.535707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 24/42] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:49 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:49.934102 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:49.935015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:49.945607 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:49.946428 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:49.947120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:49.949045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:49.950058 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:49.951012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.066191 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:50.067518 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:50.080045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.080045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.080045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.081260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.082126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.083482 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.463862 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:50.482714 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-83e27e6f-5272-4ba5-8f48-f2d8ee68f1a6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.554402 Aug 24 15:37:50.503504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 19/43] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:49 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:50.515142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:50.516643 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:50.528483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.529950 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.530621 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.531611 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.532289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.533155 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.673734 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:50.691301 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-fd028bd9-4242-48c3-81a0-38e190eaca12 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1299 microversion: 2.1 time: 0.186306 Aug 24 15:37:50.693101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 20/44] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:50 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:50.698361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-c0100b31-63df-43a6-ad1d-dd3623a683bc req-12ab2026-35e5-4d11-a0e3-5c8bb9402246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da59b0b3-378a-4907-8473-846ab2ce37df", "tag": "f83d22fb-2a97-4cad-8349-827b7079f906"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:50.713204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-c0100b31-63df-43a6-ad1d-dd3623a683bc req-12ab2026-35e5-4d11-a0e3-5c8bb9402246 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.714039 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-c0100b31-63df-43a6-ad1d-dd3623a683bc req-12ab2026-35e5-4d11-a0e3-5c8bb9402246 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.715048 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-c0100b31-63df-43a6-ad1d-dd3623a683bc req-12ab2026-35e5-4d11-a0e3-5c8bb9402246 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.763604 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-c0100b31-63df-43a6-ad1d-dd3623a683bc req-12ab2026-35e5-4d11-a0e3-5c8bb9402246 service nova] Creating event network-changed:f83d22fb-2a97-4cad-8349-827b7079f906 for instance da59b0b3-378a-4907-8473-846ab2ce37df on hv-cinder-84605 Aug 24 15:37:50.764462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-c0100b31-63df-43a6-ad1d-dd3623a683bc req-12ab2026-35e5-4d11-a0e3-5c8bb9402246 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 15:37:50.765049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-c0100b31-63df-43a6-ad1d-dd3623a683bc req-12ab2026-35e5-4d11-a0e3-5c8bb9402246 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 15:37:50.766320 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.767021 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.769010 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.770206 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.770896 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.771507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.787013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.compute.rpcapi [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 15:37:50.790006 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] Releasing lock "compute-rpcapi-router" {{(pid=132289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 15:37:50.823818 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3146ca1f-15ea-49d9-a49f-1a34cba983cb None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129334 Aug 24 15:37:50.824891 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 21/45] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:50.831948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:50.834778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:50.847126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:50.851686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.855922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.857067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.857968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:50.865229 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:50.866119 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:50.867274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0e0ee1b7-9ef9-4e24-a97e-66b06d270c3b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 0.805463 Aug 24 15:37:50.869942 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 25/46] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:50 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:37:51.195987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:51.209376 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5091718b-37d9-4fcf-b6cf-7cd1cc6f5009 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.382813 Aug 24 15:37:51.215697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 22/47] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:50 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:51.504058 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:51.504672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:51.516614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:51.517381 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:51.518567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:51.519767 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:51.522179 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:51.522832 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:51.712617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:51.713259 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:51.721982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:51.723694 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:51.724316 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:51.725702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:51.727226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:51.729788 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:51.896700 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=18 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:52.146908 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:52.173662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c2c6ff58-5373-4605-9abd-cd3dbf16bd82 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.667023 Aug 24 15:37:52.175267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 26/48] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:51 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:52.192053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:52.192768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:52.210734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:52.211236 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:52.211781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:52.212843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:52.212934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:52.213358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:52.401454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:52.415309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6480c48c-a270-4da6-be58-d8c23cddd6c2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.706463 Aug 24 15:37:52.415986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 23/49] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:51 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:37:52.422563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:52.427414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:52.442582 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:52.443192 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:52.445722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:52.446545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:52.447200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:52.447780 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:52.802241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:52.811448 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a13a4bd8-e16c-4f26-9902-9474b6834827 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 0.633681 Aug 24 15:37:52.814629 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 27/50] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:52 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:52.899993 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:52.908845 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9f4b6bda-69c7-4ffd-8134-2b8d0ca2fd64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.490796 Aug 24 15:37:52.909895 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 24/51] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:52 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:52.945595 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-a21d2f45-b64f-4340-b07a-2782c470f03d req-9749be1a-e741-4475-94a9-99ca8703a771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905f49ec-5f2b-4a83-994b-8d36385a9996", "tag": "e556ad45-52e0-45b1-a43b-9779f17bd048"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:52.956906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a21d2f45-b64f-4340-b07a-2782c470f03d req-9749be1a-e741-4475-94a9-99ca8703a771 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:52.957727 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a21d2f45-b64f-4340-b07a-2782c470f03d req-9749be1a-e741-4475-94a9-99ca8703a771 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:52.958383 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a21d2f45-b64f-4340-b07a-2782c470f03d req-9749be1a-e741-4475-94a9-99ca8703a771 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:52.976822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-a21d2f45-b64f-4340-b07a-2782c470f03d req-9749be1a-e741-4475-94a9-99ca8703a771 service nova] Creating event network-changed:e556ad45-52e0-45b1-a43b-9779f17bd048 for instance 905f49ec-5f2b-4a83-994b-8d36385a9996 on hv-cinder-84605 Aug 24 15:37:52.982778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-a21d2f45-b64f-4340-b07a-2782c470f03d req-9749be1a-e741-4475-94a9-99ca8703a771 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041762 Aug 24 15:37:52.983743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 28/52] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:53.196242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:53.197633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:53.210067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:53.210564 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:53.212125 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:53.214920 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:53.216055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:53.216655 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:53.445306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:53.446074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:53.467556 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:53.468634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:53.470480 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:53.473944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:53.475385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:53.476083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:53.643038 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:53.679771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bf47b405-54ae-4024-b29b-51d9b9e6e64b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.486567 Aug 24 15:37:53.681265 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 25/53] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:53 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:53.834508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:53.835289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:53.844402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:53.845239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:53.845874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:53.851666 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:53.852427 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:53.853090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:54.249872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:54.256614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=100 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:54.258847 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fb55bac7-2318-4a57-9df1-4c31cb89d2bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.825149 Aug 24 15:37:54.259444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 29/54] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:53 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:37:54.274410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:54.275068 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:54.281434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:54.281928 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:54.282367 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:54.295357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:54.295865 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:54.296315 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:54.417740 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:54.429264 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e4c46089-3013-45e1-90fc-5e97ebbbec5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 0.598288 Aug 24 15:37:54.430550 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 26/55] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:53 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:54.435710 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-82fd9ca8-159b-4bc5-b0e4-78d42d2297ff req-fbd8fc2d-5bdb-4b7f-8aab-1c456443fb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d719a892-4ac9-42ad-973b-ecc96a5df4a6", "tag": "0343d105-5766-479e-80bd-69cf5533dd7a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:54.448192 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-82fd9ca8-159b-4bc5-b0e4-78d42d2297ff req-fbd8fc2d-5bdb-4b7f-8aab-1c456443fb29 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:54.450310 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-82fd9ca8-159b-4bc5-b0e4-78d42d2297ff req-fbd8fc2d-5bdb-4b7f-8aab-1c456443fb29 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:54.451440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-82fd9ca8-159b-4bc5-b0e4-78d42d2297ff req-fbd8fc2d-5bdb-4b7f-8aab-1c456443fb29 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:54.466525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-82fd9ca8-159b-4bc5-b0e4-78d42d2297ff req-fbd8fc2d-5bdb-4b7f-8aab-1c456443fb29 service nova] Creating event network-changed:0343d105-5766-479e-80bd-69cf5533dd7a for instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 on hv-cinder-84605 Aug 24 15:37:54.472607 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-82fd9ca8-159b-4bc5-b0e4-78d42d2297ff req-fbd8fc2d-5bdb-4b7f-8aab-1c456443fb29 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040431 Aug 24 15:37:54.473208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 27/56] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:54.528499 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:54.537194 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e148a246-33fd-453a-8c01-7939dda81884 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.276748 Aug 24 15:37:54.537766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 30/57] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:54 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:54.704246 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:54.705064 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:54.712132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:54.728326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:54.728720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:54.729493 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:54.729976 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:54.730408 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:54.759502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=100 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:55.011361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:55.021850 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b727dd05-4aa9-4cff-8446-5063bf07145f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.322261 Aug 24 15:37:55.031559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 28/58] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:54 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:55.280430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:55.281044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:55.283127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=4 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:55.304332 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:55.305120 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:55.305740 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:55.306714 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:55.307474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:55.308192 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:55.451277 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:55.452189 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:55.465928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:55.466721 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:55.467484 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:55.472491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:55.477036 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:55.477765 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:56.084623 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:56.110982 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-51ece033-8704-4e0a-a40f-91b0dbfe2e85 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.834258 Aug 24 15:37:56.119222 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 31/59] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:55 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:56.133537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:56.136851 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:56.158504 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:56.159727 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:56.162907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:56.164647 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:56.165389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:56.167194 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:56.177621 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:56.190982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-abd53ba3-c53b-4869-a142-8e47ce84634c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 0.742120 Aug 24 15:37:56.192230 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 29/60] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:55 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:37:56.204045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:56.207916 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:56.223851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:56.225435 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:56.225927 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:56.228390 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:56.228904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:56.229357 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:56.264795 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=28 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:57.014708 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:57.039902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e3329dcd-aafe-4f0d-b1a4-078de9703bc6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.838896 Aug 24 15:37:57.040780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:57.042458 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 30/61] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:56 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:57.055919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-64878c68-65df-461b-b776-dea7829c1a43 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.931165 Aug 24 15:37:57.056910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 32/62] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:56 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:57.142341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:57.143061 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:57.145305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:57.152988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:57.155135 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:57.155742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:57.157576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:57.159341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:57.161343 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:57.203375 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-fed4edb5-9ecc-43ef-a77f-c01973f4045b req-7d90f114-5415-4023-b010-39b27d8bbfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9197f87-6b4b-48c3-82b6-291e3fa22b44", "name": "network-vif-plugged", "status": "completed", "tag": "d16aa60b-75fe-494c-ab0b-80320b598060"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:57.242886 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fed4edb5-9ecc-43ef-a77f-c01973f4045b req-7d90f114-5415-4023-b010-39b27d8bbfdd service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:57.243391 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fed4edb5-9ecc-43ef-a77f-c01973f4045b req-7d90f114-5415-4023-b010-39b27d8bbfdd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:57.243830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fed4edb5-9ecc-43ef-a77f-c01973f4045b req-7d90f114-5415-4023-b010-39b27d8bbfdd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:57.297115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-fed4edb5-9ecc-43ef-a77f-c01973f4045b req-7d90f114-5415-4023-b010-39b27d8bbfdd service nova] Creating event network-vif-plugged:d16aa60b-75fe-494c-ab0b-80320b598060 for instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 on hv-cinder-84605 Aug 24 15:37:57.313386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-fed4edb5-9ecc-43ef-a77f-c01973f4045b req-7d90f114-5415-4023-b010-39b27d8bbfdd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268744 Aug 24 15:37:57.314257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 31/63] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:57.340592 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:57.342395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:57.356636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:57.357113 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:57.357636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:57.358697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:57.359337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:57.359844 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:57.438105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:57.447899 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3e6128ff-ffa3-49d8-bd61-684cdb791aea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.310251 Aug 24 15:37:57.451437 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 33/64] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:57 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:57.584443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:57.592890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5d95f2f2-46fc-41d4-ad35-1592a46516fb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 0.267512 Aug 24 15:37:57.593477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 32/65] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:57 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:58.069912 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:58.070530 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:58.080222 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.081103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:58.081335 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.081951 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.082245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:58.083094 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.084061 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.086166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.097346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.098586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.100204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.102839 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.103347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.104061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.544918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:58.553834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b5787165-60ac-404e-ba76-fd93323c53ef tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.487719 Aug 24 15:37:58.556068 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 34/66] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:58 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:58.558322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:58.568804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:58.569640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:58.569962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7fb0a2a2-43c8-4891-a971-f7a427cc820c tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.492340 Aug 24 15:37:58.570630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 33/67] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:58 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:58.588279 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.589248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.589920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.590919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.591669 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.593417 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.615011 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:58.615628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:58.631852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.641050 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.651392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.655294 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:58.655988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:58.659348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:58.871482 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:58.880732 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-92a746cb-8453-4b33-8c22-1e4f3b4b8a91 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.320661 Aug 24 15:37:58.886374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 35/68] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:58 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:58.913127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:58.921678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a7add3c3-ffdf-4441-bcc7-f705a010f1e0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 0.312210 Aug 24 15:37:58.922318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 34/69] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:58 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:37:59.333092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-6992ee7c-aad7-4fcc-bca2-75447409347a req-4aa5be4d-41e7-42e9-9f95-21f3b8a932bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b68fc0-0cf5-4107-826c-b811fd855918", "name": "network-vif-plugged", "status": "completed", "tag": "4bf86c74-fa64-4d0d-8726-16e4fd8bc9d0"}, {"server_uuid": "da59b0b3-378a-4907-8473-846ab2ce37df", "name": "network-vif-plugged", "status": "completed", "tag": "f83d22fb-2a97-4cad-8349-827b7079f906"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:59.344876 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6992ee7c-aad7-4fcc-bca2-75447409347a req-4aa5be4d-41e7-42e9-9f95-21f3b8a932bb service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:59.346043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6992ee7c-aad7-4fcc-bca2-75447409347a req-4aa5be4d-41e7-42e9-9f95-21f3b8a932bb service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:59.346902 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6992ee7c-aad7-4fcc-bca2-75447409347a req-4aa5be4d-41e7-42e9-9f95-21f3b8a932bb service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:59.364024 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-6992ee7c-aad7-4fcc-bca2-75447409347a req-4aa5be4d-41e7-42e9-9f95-21f3b8a932bb service nova] Creating event network-vif-plugged:4bf86c74-fa64-4d0d-8726-16e4fd8bc9d0 for instance 97b68fc0-0cf5-4107-826c-b811fd855918 on hv-cinder-84605 Aug 24 15:37:59.364771 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-6992ee7c-aad7-4fcc-bca2-75447409347a req-4aa5be4d-41e7-42e9-9f95-21f3b8a932bb service nova] Creating event network-vif-plugged:f83d22fb-2a97-4cad-8349-827b7079f906 for instance da59b0b3-378a-4907-8473-846ab2ce37df on hv-cinder-84605 Aug 24 15:37:59.371633 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-6992ee7c-aad7-4fcc-bca2-75447409347a req-4aa5be4d-41e7-42e9-9f95-21f3b8a932bb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043017 Aug 24 15:37:59.372803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 36/70] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:59.578634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:59.579331 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:59.592481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:59.593163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:59.606738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:59.607236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:59.607676 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:59.608389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:59.608838 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:59.610049 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:59.612300 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:59.613079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:59.613702 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:59.623556 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:59.624110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:59.624552 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:00.271993 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:00.291392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a79c35b4-afc3-4e86-b196-2026455cc66a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.717702 Aug 24 15:38:00.292502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 35/71] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:59 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:00.297276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:00.298137 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:00.308276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:00.310200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:00.312746 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:00.313746 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:00.314502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:00.321551 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:00.331474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:00.340355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-19012241-9b4c-4f6b-ab55-557fb0321ed3 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.752777 Aug 24 15:38:00.347161 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 37/72] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:59 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:00.367878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:00.369426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:00.393052 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:00.393581 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:00.394024 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:00.394772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:00.395236 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:00.395665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:00.786293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=10 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:00.818462 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:00.834856 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:00.888232 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f8beb565-0147-4852-a751-daad0a49aa45 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1321 microversion: 2.1 time: 0.538190 Aug 24 15:38:00.890382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 38/73] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:00 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:00.906155 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1fdbaff1-a1c6-434c-8a6c-c4051e99abea tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.612394 Aug 24 15:38:00.923897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 36/74] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:00 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:01.326045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:01.326536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:01.333252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.333746 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.334181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.335334 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.335986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.336796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.368300 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:01.368938 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:01.376795 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.377321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.377749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.378501 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.378847 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.379261 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.545718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:01.562171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-44f08ad4-ce84-41e6-bee3-c3c248084050 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.252964 Aug 24 15:38:01.563011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 39/75] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:01 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:01.569526 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-9cddbf62-c434-48df-8a9d-efdf52697835 req-4df2b1ea-b25e-448e-a786-ab26f4edfe5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905f49ec-5f2b-4a83-994b-8d36385a9996", "name": "network-vif-plugged", "status": "completed", "tag": "e556ad45-52e0-45b1-a43b-9779f17bd048"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:01.576034 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:01.581651 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9cddbf62-c434-48df-8a9d-efdf52697835 req-4df2b1ea-b25e-448e-a786-ab26f4edfe5b service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.582359 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9cddbf62-c434-48df-8a9d-efdf52697835 req-4df2b1ea-b25e-448e-a786-ab26f4edfe5b service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.583066 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9cddbf62-c434-48df-8a9d-efdf52697835 req-4df2b1ea-b25e-448e-a786-ab26f4edfe5b service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.584986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7873532e-055a-41de-879b-8950d4a4de6e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1315 microversion: 2.1 time: 0.220763 Aug 24 15:38:01.585749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 37/76] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:01 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:01.597525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-9cddbf62-c434-48df-8a9d-efdf52697835 req-4df2b1ea-b25e-448e-a786-ab26f4edfe5b service nova] Creating event network-vif-plugged:e556ad45-52e0-45b1-a43b-9779f17bd048 for instance 905f49ec-5f2b-4a83-994b-8d36385a9996 on hv-cinder-84605 Aug 24 15:38:01.602906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-9cddbf62-c434-48df-8a9d-efdf52697835 req-4df2b1ea-b25e-448e-a786-ab26f4edfe5b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037640 Aug 24 15:38:01.604166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 40/77] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:01.909573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:01.910181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:01.917332 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.918002 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.918660 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.919462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.920163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.920696 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.929380 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:01.930360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:01.950357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.951701 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.952507 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.953382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.954018 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.954984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.262382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:02.272495 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-77ac652f-cac8-4dc8-b7dd-5ac1ee73c1e5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.347574 Aug 24 15:38:02.275149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 41/78] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:01 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:02.340557 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:02.351511 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-29946a70-0d9c-4d9c-8c38-c3deebe19767 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1514 microversion: 2.1 time: 0.445590 Aug 24 15:38:02.368286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 38/79] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:01 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1514 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:02.375138 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:02.378085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:02.385460 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:02.386342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:02.387335 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.388249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:02.388960 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:02.389461 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.460948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lazy-loading 'flavor' on Instance uuid da59b0b3-378a-4907-8473-846ab2ce37df {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:38:02.587324 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:02.588353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:02.602714 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:02.603784 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:02.604903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.606165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:02.607295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:02.607911 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.702549 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-472abc87-8c8b-47b4-b6e7-3c31d4b78249 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df/action" status: 200 len: 32 microversion: 2.1 time: 0.332825 Aug 24 15:38:02.707994 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 42/80] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:38:02 2022] POST /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:38:02.731183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:02.732306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:02.743238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:02.744274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:02.745069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.746340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:02.747375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:02.748007 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.125770 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:03.138772 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b1316079-732f-4290-8635-ac136eea9a51 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.556341 Aug 24 15:38:03.140094 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 39/81] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:02 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:03.148238 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:03.149875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:03.150992 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:03.167285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:03.168029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:03.168667 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.169547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:03.177026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3f480960-d4aa-420a-b250-d7237074b081 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1501 microversion: 2.1 time: 0.471361 Aug 24 15:38:03.177435 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:03.178047 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.181990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 43/82] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:02 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:03.305633 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:03.306251 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:03.324133 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:03.324854 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:03.325482 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.326273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:03.326674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:03.327103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.620923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:03.635311 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2f074b4f-4880-43fa-9687-f10aba6f4d5e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.494007 Aug 24 15:38:03.635918 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 40/83] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:03 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:03.654582 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-b10384f9-7e69-46dd-8e89-a5ed12a2569a req-bf41e39d-e1fa-40ec-90df-c662e785262d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d719a892-4ac9-42ad-973b-ecc96a5df4a6", "name": "network-vif-plugged", "status": "completed", "tag": "0343d105-5766-479e-80bd-69cf5533dd7a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:03.666022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-b10384f9-7e69-46dd-8e89-a5ed12a2569a req-bf41e39d-e1fa-40ec-90df-c662e785262d service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:03.666756 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-b10384f9-7e69-46dd-8e89-a5ed12a2569a req-bf41e39d-e1fa-40ec-90df-c662e785262d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:03.667537 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-b10384f9-7e69-46dd-8e89-a5ed12a2569a req-bf41e39d-e1fa-40ec-90df-c662e785262d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.682433 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-b10384f9-7e69-46dd-8e89-a5ed12a2569a req-bf41e39d-e1fa-40ec-90df-c662e785262d service nova] Creating event network-vif-plugged:0343d105-5766-479e-80bd-69cf5533dd7a for instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 on hv-cinder-84605 Aug 24 15:38:03.687897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-b10384f9-7e69-46dd-8e89-a5ed12a2569a req-bf41e39d-e1fa-40ec-90df-c662e785262d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036972 Aug 24 15:38:03.689580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 41/84] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:38:03.712139 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:03.722537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fbcd66bf-bacd-4dc2-a60c-ae7b610fc99b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.431040 Aug 24 15:38:03.723557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 44/85] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:03 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:04.173063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:04.174499 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:04.184077 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.184571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.185004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.185706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.188666 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.189368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.340928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:04.353140 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-26b7c862-d129-420f-a736-42f4e743e7aa tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1363 microversion: 2.1 time: 0.182531 Aug 24 15:38:04.353140 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 42/86] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:04 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:04.658128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:04.659203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:04.667899 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.668562 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.669064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.670208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.670788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.671690 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.745472 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:04.746062 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:04.754742 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.755620 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.757143 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.758109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.758902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.759661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.972473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:04.976941 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:04.984285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b37440ba-91ee-45e0-853d-ae06431f4d0e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.330816 Aug 24 15:38:04.985167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 45/87] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:04 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:05.067875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:05.076865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8f925273-7d67-426f-aa80-437311cf4cdf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.336445 Aug 24 15:38:05.077695 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 43/88] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:04 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:05.177755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b85dffd7-517c-4681-aebc-7ab0d12122b6"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:05.180657 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:05.191185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.192099 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.193194 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.194254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.195091 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.195797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.372318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:05.372939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:05.379386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.379960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.380464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.381668 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.382379 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.383026 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.581214 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:05.591345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-dec3277d-9dba-44ef-bf13-bab6e98a5108 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1549 microversion: 2.1 time: 0.222841 Aug 24 15:38:05.592923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 44/89] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:05 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:05.619127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:05.619701 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:05.626817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.628186 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.628704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.630023 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.630566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.631142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.748491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3581365d-5941-413e-9a3c-5b29d6d319b5 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135931 Aug 24 15:38:05.749118 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 45/90] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:38:05 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:38:06.006908 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:06.007786 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:06.015779 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.016600 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.018862 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:06.019897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.020497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.021065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:06.049324 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=100 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:06.175604 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:06.183790 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e20ca814-4ac7-480c-91ab-ee402c383bbb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.182278 Aug 24 15:38:06.184417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 46/91] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:06 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:06.193958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:06.193958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:06.199467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.199955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.200410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:06.201269 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.201805 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.202225 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:06.340578 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:06.349525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bd7cddcb-242e-4ca7-9884-4db84dfcfd4d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.164135 Aug 24 15:38:06.350106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 47/92] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:06 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:07.070056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-83a1179d-76e4-4526-b4e3-0ea96765aaeb req-8fe0c860-4bc7-41bb-82de-18f141a31800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905f49ec-5f2b-4a83-994b-8d36385a9996", "tag": "e556ad45-52e0-45b1-a43b-9779f17bd048"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:07.080418 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-83a1179d-76e4-4526-b4e3-0ea96765aaeb req-8fe0c860-4bc7-41bb-82de-18f141a31800 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.080888 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-83a1179d-76e4-4526-b4e3-0ea96765aaeb req-8fe0c860-4bc7-41bb-82de-18f141a31800 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.081313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-83a1179d-76e4-4526-b4e3-0ea96765aaeb req-8fe0c860-4bc7-41bb-82de-18f141a31800 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.092608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-83a1179d-76e4-4526-b4e3-0ea96765aaeb req-8fe0c860-4bc7-41bb-82de-18f141a31800 service nova] Creating event network-changed:e556ad45-52e0-45b1-a43b-9779f17bd048 for instance 905f49ec-5f2b-4a83-994b-8d36385a9996 on hv-cinder-84605 Aug 24 15:38:07.099420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-83a1179d-76e4-4526-b4e3-0ea96765aaeb req-8fe0c860-4bc7-41bb-82de-18f141a31800 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032922 Aug 24 15:38:07.100165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 48/93] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:38:07.206339 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:07.207036 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:07.213656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.214147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.214586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.215362 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.215818 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.216286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.373256 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:07.381581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e47b509b-a41f-4726-91ab-9fc0bb8277d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.180073 Aug 24 15:38:07.382151 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 49/94] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:07 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:07.394763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:07.394763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:07.394763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.394763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.395148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.395148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.395148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.395426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.539257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:07.547050 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cb8b184c-8ac7-444c-afbe-7528babf0827 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.163907 Aug 24 15:38:07.547620 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 50/95] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:07 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:08.403257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:08.403998 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:08.410542 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.411132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.411572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.412258 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.412882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.413311 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.482706 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f46eca3e-f681-41c5-9c5b-fd7f8e2b0e51 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "POST /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.311223 Aug 24 15:38:08.483406 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 46/96] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:38:05 2022] POST /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918/os-volume_attachments => generated 194 bytes in 3313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:08.552950 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:08.560594 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d75fa315-3f8c-46ce-bd91-5c5fc66f4bfd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.161309 Aug 24 15:38:08.561154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 51/97] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:08 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:08.569017 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:08.569715 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:08.576150 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.576626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.577060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.577751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.578221 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.578624 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.706329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:08.714367 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1eb3085a-fd49-4059-8d19-880e89faf448 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.149651 Aug 24 15:38:08.714965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 47/98] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:08 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:09.581243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:09.581864 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:09.588154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:09.588633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:09.589062 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:09.589774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:09.590194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:09.590612 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:09.717742 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:09.726144 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4811d237-763c-4aac-b519-3b699d17df25 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.148755 Aug 24 15:38:09.726727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 52/99] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:09 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:09.736277 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:09.736986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:09.743314 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:09.743786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:09.744214 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:09.744897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:09.745347 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:09.745762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:09.872172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:09.880053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-226ac254-cd52-47cf-8917-80c78c687031 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.148228 Aug 24 15:38:09.880638 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 48/100] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:09 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:10.747569 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:10.748100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:10.754543 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.755052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.755484 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:10.756160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.756611 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.757028 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:10.886446 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:10.894403 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-48400a46-12ea-4715-a665-72ff7009b2c9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.150710 Aug 24 15:38:10.895006 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 53/101] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:10 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:10.901965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:10.902569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:10.908942 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.909409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.909855 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:10.910534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.911008 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.911426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:11.038167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:11.045622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c9be8ad8-b326-4771-9c23-5cbcba9a200a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1367 microversion: 2.1 time: 0.147789 Aug 24 15:38:11.046181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 49/102] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:10 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:11.914912 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:11.915549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:11.921816 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:11.921914 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:11.922343 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:11.923111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:11.923554 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:11.924147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:12.062446 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:12.068743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:12.069988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:12.071385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-80bf12e8-f1c0-4f2f-b033-44bfa4d6c2e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.160446 Aug 24 15:38:12.071954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 54/103] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:11 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:12.078191 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:12.078980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:12.080112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:12.080975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:12.081442 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:12.081867 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:12.217032 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:12.225026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5147ff03-d404-40bc-8730-2ad7cdb15abd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1556 microversion: 2.1 time: 0.162046 Aug 24 15:38:12.225601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 50/104] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:12 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:12.245385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:12.245876 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:12.252826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:12.253307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:12.253741 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:12.254426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:12.254913 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:12.255334 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:12.331691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-33d726ee-4842-434a-8ed7-bbc23170316b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090077 Aug 24 15:38:12.332290 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 55/105] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:38:12 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:13.092810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:13.093444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:13.100717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:13.101208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:13.101650 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:13.102347 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:13.102910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:13.103342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:13.352227 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:13.360737 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0fde090a-b190-497f-8dc9-18939a217de7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.271695 Aug 24 15:38:13.361319 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 51/106] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:13 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:13.729263 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-465bf72d-e44f-48bd-be85-10284c68fcf1 req-0b726a2c-ced4-4e6a-92b6-d7f2ba0261dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d719a892-4ac9-42ad-973b-ecc96a5df4a6", "tag": "0343d105-5766-479e-80bd-69cf5533dd7a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:13.739558 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-465bf72d-e44f-48bd-be85-10284c68fcf1 req-0b726a2c-ced4-4e6a-92b6-d7f2ba0261dd service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:13.740201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-465bf72d-e44f-48bd-be85-10284c68fcf1 req-0b726a2c-ced4-4e6a-92b6-d7f2ba0261dd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:13.740524 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-465bf72d-e44f-48bd-be85-10284c68fcf1 req-0b726a2c-ced4-4e6a-92b6-d7f2ba0261dd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:13.753142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-465bf72d-e44f-48bd-be85-10284c68fcf1 req-0b726a2c-ced4-4e6a-92b6-d7f2ba0261dd service nova] Creating event network-changed:0343d105-5766-479e-80bd-69cf5533dd7a for instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 on hv-cinder-84605 Aug 24 15:38:13.759162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-465bf72d-e44f-48bd-be85-10284c68fcf1 req-0b726a2c-ced4-4e6a-92b6-d7f2ba0261dd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033391 Aug 24 15:38:13.763625 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 56/107] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:14.389649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:14.390264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:14.396796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:14.397285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:14.397720 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:14.398415 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:14.398899 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:14.399323 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:14.542583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:14.553212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ad5f27d6-2be8-438c-99d5-e46d14b633a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.167448 Aug 24 15:38:14.553905 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 52/108] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:14 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:15.576375 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:15.577353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:15.584447 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:15.585039 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:15.585533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:15.586479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:15.587226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:15.587661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:15.745658 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:15.756534 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bdaea598-323f-4c3a-89dc-f03e22ae9023 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.184296 Aug 24 15:38:15.774065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 57/109] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:15 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:16.780629 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:16.781245 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:16.787668 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:16.788155 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:16.788583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:16.789269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:16.789721 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:16.790139 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:16.937117 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:16.946106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e7d5d41e-6f35-4604-89ef-39316bab97ff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.169468 Aug 24 15:38:16.946952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 53/110] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:16 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:17.968490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:17.969053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:17.972426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=86 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:17.978361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:17.978874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:17.979307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:17.980061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:17.980547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:17.980964 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:18.247294 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:18.268699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cb6d7866-6db0-4982-8bf5-a11123ffa668 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.304537 Aug 24 15:38:18.269566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 58/111] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:17 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:19.292150 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:19.292939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:19.299955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:19.300456 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:19.300890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:19.301851 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:19.302308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:19.302960 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:19.511165 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:19.520433 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ed03073a-2d4c-4253-bc52-5a70a52c6f27 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.231999 Aug 24 15:38:19.521031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 54/112] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:19 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:20.556495 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:20.557288 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:20.568850 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:20.569811 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:20.570253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:20.571315 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:20.571779 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:20.572207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:20.732196 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:20.743342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cb260cbe-3bce-452c-943a-09671830315f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.203860 Aug 24 15:38:20.744710 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 59/113] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:20 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:21.768198 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:21.768810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:21.775890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:21.776679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:21.777266 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:21.778138 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:21.778768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:21.779976 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:21.963105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:21.972962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-80a0557f-6679-4009-9c8d-360a80b045bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.208713 Aug 24 15:38:21.986141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 55/114] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:21 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:22.993369 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:22.993986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:23.003124 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:23.003700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:23.004406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:23.005311 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:23.006078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:23.008079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:23.174911 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:23.186822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2a1083e0-dcc3-401d-b375-1080553ec3fc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.197191 Aug 24 15:38:23.187533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 60/115] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:22 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:24.207746 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:24.208571 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:24.218422 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:24.218992 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:24.219950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:24.220748 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:24.221570 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:24.222182 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:24.376934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:24.384900 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d37edaed-db12-4db0-8fd1-04153cc1615f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.181262 Aug 24 15:38:24.385470 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 56/116] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:24 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:25.405960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:25.406571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:25.413162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:25.413647 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:25.414083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:25.414797 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:25.415259 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:25.415682 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:25.558168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:25.565982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c713ae05-4e83-462a-b68b-ca1381d56e73 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.163906 Aug 24 15:38:25.566548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 61/117] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:25 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:26.586552 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:26.587193 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:26.593861 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:26.594823 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:26.595276 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:26.596237 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:26.596707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:26.597139 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:26.730691 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:26.739307 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-44c9aaad-a6ae-4af0-a0cf-77cc68dcad49 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.156916 Aug 24 15:38:26.739882 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 57/118] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:26 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:27.760158 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:27.760773 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:27.766798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:27.767283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:27.767717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:27.768407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:27.768858 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:27.769278 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:27.901566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:27.909885 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3dac5495-7633-4e3b-bf35-aa4c5dd1906d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.153671 Aug 24 15:38:27.910448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 62/119] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:27 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:28.931506 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:28.932146 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:28.934672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=50 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:28.940579 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:28.941060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:28.941537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:28.942233 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:28.942817 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:28.943248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:29.082912 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:29.090892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-38d632b7-19fe-4bf1-9908-48195c20e654 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.163279 Aug 24 15:38:29.091508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 58/120] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:28 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:30.055895 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:30.056381 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:30.062341 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:30.063351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:30.063971 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:30.064780 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:30.065228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:30.065652 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:30.089621 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:38:30.112651 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:30.113277 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:30.119824 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:30.120299 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:30.120773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:30.121474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:30.121929 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:30.122358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:30.129991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:30.183254 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-93a41e41-73bd-4fcd-ac5f-f4a57ac8f2b0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "DELETE /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 204 len: 0 microversion: 2.1 time: 0.130932 Aug 24 15:38:30.183856 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 63/121] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:38:30 2022] DELETE /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:38:30.192337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:30.192957 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:30.198720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:30.199207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:30.199638 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:30.200369 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:30.200821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:30.201264 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:30.289382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:30.298386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2fab905a-dce0-4ee7-93d7-86701e8566fe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.189715 Aug 24 15:38:30.299032 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 59/122] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:30 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:30.363385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:30.371596 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4173fc96-d65e-4466-bd20-9d49145be185 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.183537 Aug 24 15:38:30.372169 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 64/123] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:30 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:31.320059 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:31.320728 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:31.327195 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:31.327677 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:31.328112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:31.328878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:31.329428 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:31.329857 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:31.392614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:31.393277 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:31.399106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:31.399583 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:31.400012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:31.400702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:31.401147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:31.401565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:31.496870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:31.505391 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-470c3785-0408-4e59-8fdc-46b6abccc9de tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.189150 Aug 24 15:38:31.505973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 60/124] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:31 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:31.558999 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:31.567269 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e09b6baf-6713-4df6-a1ff-1add84fb1c64 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.178498 Aug 24 15:38:31.568152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 65/125] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:31 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:32.527243 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:32.527842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:32.534917 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:32.535391 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:32.535819 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:32.536490 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:32.536943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:32.537360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:32.541221 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:32.588212 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:32.588817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:32.595662 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:32.596402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:32.596833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:32.597523 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:32.597973 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:32.598397 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:32.916338 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:32.926144 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d1fd116c-4b34-474d-bb1f-b4227ad41e7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.402638 Aug 24 15:38:32.926968 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 61/126] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:32 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:32.958915 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:32.967051 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8dc6d9db-5eb6-4f9b-a12a-a86cafc13413 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.382604 Aug 24 15:38:32.967565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 66/127] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:32 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:33.947981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:33.949239 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:33.956430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:33.956921 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:33.957357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:33.958064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:33.958511 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:33.958957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:33.989131 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:33.989831 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:33.996238 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:33.996801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:33.997293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:33.998152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:33.998585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:33.999276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:34.158841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:34.167027 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3a877332-d007-43cc-afb8-c7bfa6512993 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.223273 Aug 24 15:38:34.167721 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 62/128] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:33 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:34.185702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:34.194410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-89baa4fd-4c36-4834-b31a-482455d7c283 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.210133 Aug 24 15:38:34.195001 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 67/129] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:33 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:35.189764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:35.190344 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:35.197183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:35.197761 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:35.198086 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:35.198807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:35.199262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:35.199679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:35.216830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:35.217901 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:35.224762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:35.225328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:35.225945 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:35.226692 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:35.227352 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:35.227778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:35.389009 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:35.396764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cf6a8574-05d0-49b0-9924-2f13a1b041d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.211467 Aug 24 15:38:35.397340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 63/130] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:35 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:35.410906 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:35.418953 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-365fb2f8-53d4-4cf3-bca1-9363ec13d59d tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.206747 Aug 24 15:38:35.419512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 68/131] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:35 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:36.417916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:36.418525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:36.424943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:36.425423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:36.425867 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:36.426556 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:36.427043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:36.427469 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:36.440420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:36.441031 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:36.446884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:36.447364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:36.447797 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:36.448507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:36.448955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:36.449370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:36.611820 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:36.619512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1b8886c6-6f44-4133-832e-0153d1e75d88 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.205517 Aug 24 15:38:36.620189 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 64/132] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:36 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:36.633113 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:36.641455 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ef03e2fc-6ad2-40a3-83c2-530d9346632a tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.204877 Aug 24 15:38:36.642017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 69/133] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:36 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:37.641626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:37.642158 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:37.648472 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:37.648950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:37.649385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:37.650072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:37.650524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:37.650981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:37.661158 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:37.661761 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:37.667599 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:37.668067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:37.668486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:37.669159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:37.669603 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:37.670017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:37.842957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:37.852029 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-905613c8-1449-4b13-a87c-47356959a5cd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.214970 Aug 24 15:38:37.852955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 65/134] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:37 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:37.855089 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:37.864272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7553ab7f-a7c0-4444-9f22-d674a8d475ae tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.206854 Aug 24 15:38:37.866675 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 70/135] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:37 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:38.873187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:38.873802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:38.880253 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:38.880742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:38.881179 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:38.881870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:38.882333 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:38.882784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:38.887252 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:38.887895 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:38.895236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:38.895835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:38.896329 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:38.897168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:38.897703 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:38.898123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:39.093101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:39.098000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:39.101262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2628473f-d368-4363-95dd-a325c24bab18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.231909 Aug 24 15:38:39.101847 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 66/136] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:38 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:39.106450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cdc2e465-ff7b-44c7-b14d-cc5c81f13c92 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.223057 Aug 24 15:38:39.107111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 71/137] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:38 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:40.121163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:40.121777 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:40.128246 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:40.128829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:40.128959 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:40.129314 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:40.129749 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:40.130446 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:40.130939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:40.131366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:40.134817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:40.135288 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:40.135710 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:40.136386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:40.136830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:40.137240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:40.327212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:40.332349 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:40.335422 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0271c7f4-09dd-4d0a-a5fc-07b50b8d0bff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.218064 Aug 24 15:38:40.336002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 67/138] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:40 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:40.340714 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a61284c5-bcaf-4f24-8e39-cc3f78209685 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1553 microversion: 2.1 time: 0.217200 Aug 24 15:38:40.341273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 72/139] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:40 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:41.025114 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-a4cf98cc-bf19-4db4-9e5b-3b923ef2f801 req-c6f91d35-397d-49e9-ad67-b425d080af1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b68fc0-0cf5-4107-826c-b811fd855918", "name": "network-vif-deleted", "tag": "4bf86c74-fa64-4d0d-8726-16e4fd8bc9d0"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:41.036415 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a4cf98cc-bf19-4db4-9e5b-3b923ef2f801 req-c6f91d35-397d-49e9-ad67-b425d080af1d service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:41.036989 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a4cf98cc-bf19-4db4-9e5b-3b923ef2f801 req-c6f91d35-397d-49e9-ad67-b425d080af1d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:41.037508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a4cf98cc-bf19-4db4-9e5b-3b923ef2f801 req-c6f91d35-397d-49e9-ad67-b425d080af1d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:41.049326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-a4cf98cc-bf19-4db4-9e5b-3b923ef2f801 req-c6f91d35-397d-49e9-ad67-b425d080af1d service nova] Creating event network-vif-deleted:4bf86c74-fa64-4d0d-8726-16e4fd8bc9d0 for instance 97b68fc0-0cf5-4107-826c-b811fd855918 on hv-cinder-84605 Aug 24 15:38:41.054587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-a4cf98cc-bf19-4db4-9e5b-3b923ef2f801 req-c6f91d35-397d-49e9-ad67-b425d080af1d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033242 Aug 24 15:38:41.055457 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 68/140] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:41.357359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:41.359686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:41.362400 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:41.363299 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:41.365152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:41.365630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:41.366056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:41.366786 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:41.367236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:41.367598 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:41.369642 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:41.370281 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:41.370745 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:41.371445 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:41.371912 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:41.372336 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:41.468456 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:41.478129 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e0b7ab8d-a574-460f-b57f-46e54a31b7d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1511 microversion: 2.1 time: 0.120605 Aug 24 15:38:41.478818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 69/141] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:41 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1511 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:41.531283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:41.539671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-07ccbca1-1489-40dc-a23c-39c089d6de9a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.187263 Aug 24 15:38:41.540423 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 73/142] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:41 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:42.499291 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:42.499891 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:42.507005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:42.507484 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:42.507917 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:42.508600 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:42.509042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:42.509461 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:42.561922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:42.562532 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:42.569683 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:42.571079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:42.571752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:42.572492 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:42.574472 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:42.574472 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:42.601693 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:42.622733 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-bf47b1bd-563f-44c0-8861-b4b9847cef7e tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1346 microversion: 2.1 time: 0.126974 Aug 24 15:38:42.623735 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 70/143] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:42 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:42.744814 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:42.757724 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8811ddc1-0a22-4934-b248-e8983999672b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.199888 Aug 24 15:38:42.758436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 74/144] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:42 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:43.649135 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:43.649743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:43.656071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:43.656561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:43.657045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:43.657779 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:43.658237 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:43.658680 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:43.739651 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:43.747713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-618f1fbf-4d51-4156-9ca5-a56e1b7275cd tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1346 microversion: 2.1 time: 0.102444 Aug 24 15:38:43.748270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 71/145] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:43 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:43.781750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:43.782415 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:43.788348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:43.788829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:43.789259 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:43.789941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:43.790395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:43.790854 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:43.919016 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:43.927353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8bff6ebe-bf70-4124-8002-9139dabe5d35 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.149490 Aug 24 15:38:43.927923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 75/146] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:43 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:44.775531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:44.776492 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:44.785399 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:44.786095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:44.786864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:44.787693 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:44.788298 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:44.788926 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:44.820066 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:44.820683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:44.821126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:44.821566 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lazy-loading 'fault' on Instance uuid 97b68fc0-0cf5-4107-826c-b811fd855918 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:38:44.867098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490535729c64eaa8e89bf8eb8d56290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9eb7c5b5f94cd78546a3c1cc3d7cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:44.876484 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-916be5b6-50e5-48d9-b759-6b82ed1298d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 200 len: 1351 microversion: 2.1 time: 0.106836 Aug 24 15:38:44.889830 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 72/147] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:44 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:44.954841 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:44.954841 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:44.957940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:44.958543 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:44.959026 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:44.960207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:44.960870 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:44.961462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:45.129738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:45.137536 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-42ab307d-02d0-487d-8924-09df093cb96f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.192403 Aug 24 15:38:45.138107 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 76/148] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:44 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:45.898047 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:45.898772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:45.905369 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:45.905912 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:45.906886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:45.907589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:45.908042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:45.908468 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:45.921981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] HTTP exception thrown: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Request method failure captured: Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 HTTP/1.1 Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkWyRjn_dYwHn7Eq4GnToC0LK3Du4VR0oYKpm5jKkhcFYNksDoq86cycyV_vBhYzBsRuTZFFLd-AFkXuJqH2SXN_Mmr5bSyKj2QMzu0lqBjKAXRgiWd4Xz0RaABZiL42Vp1g8v5Q-7K-gywBZ9nKTQuTFcyjWpNy9A8PHz_d9LzZ72c Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:38:45.927801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee9eb7c5b5f94cd78546a3c1cc3d7cc7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}] Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: b490535729c64eaa8e89bf8eb8d56290 Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:45.929207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '97b68fc0-0cf5-4107-826c-b811fd855918'} Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:38:45.929935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:45.931255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:45.932286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Returning 404 to user: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:38:45.932286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e3adc99a-1fba-4974-a35a-58ef5d0722fe tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 404 len: 111 microversion: 2.1 time: 0.035717 Aug 24 15:38:45.932286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 73/149] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:45 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:38:46.050065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:46.052442 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:46.058416 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:46.058939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:46.059372 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:46.060111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:46.060604 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:46.061046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:46.074471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] HTTP exception thrown: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Request method failure captured: Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918/os-volume_attachments HTTP/1.1 Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkWyRjn_dYwHn7Eq4GnToC0LK3Du4VR0oYKpm5jKkhcFYNksDoq86cycyV_vBhYzBsRuTZFFLd-AFkXuJqH2SXN_Mmr5bSyKj2QMzu0lqBjKAXRgiWd4Xz0RaABZiL42Vp1g8v5Q-7K-gywBZ9nKTQuTFcyjWpNy9A8PHz_d9LzZ72c Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:38:46.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee9eb7c5b5f94cd78546a3c1cc3d7cc7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}] Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: b490535729c64eaa8e89bf8eb8d56290 Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:46.081644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'server_id': '97b68fc0-0cf5-4107-826c-b811fd855918'} Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:38:46.082302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:46.083545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:46.084849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Returning 404 to user: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:38:46.084849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2336f623-b42e-497b-9e13-13cf562785d0 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036446 Aug 24 15:38:46.084849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 77/150] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:38:46 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:38:46.158884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:46.159641 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:46.166464 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:46.167053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:46.167549 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:46.168249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:46.168871 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:46.169779 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:46.334374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:46.343868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a98b5bcb-07af-4fa7-b807-68cfa4215a68 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.188767 Aug 24 15:38:46.344712 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 74/151] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:46 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:47.307003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:47.307487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:47.314411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:47.314987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:47.315619 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:47.316505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:47.317139 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:47.317740 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:47.337561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] HTTP exception thrown: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Request method failure captured: Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 HTTP/1.1 Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkWyRjn_dYwHn7Eq4GnToC0LK3Du4VR0oYKpm5jKkhcFYNksDoq86cycyV_vBhYzBsRuTZFFLd-AFkXuJqH2SXN_Mmr5bSyKj2QMzu0lqBjKAXRgiWd4Xz0RaABZiL42Vp1g8v5Q-7K-gywBZ9nKTQuTFcyjWpNy9A8PHz_d9LzZ72c Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:38:47.340471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee9eb7c5b5f94cd78546a3c1cc3d7cc7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}] Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: b490535729c64eaa8e89bf8eb8d56290 Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.341628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '97b68fc0-0cf5-4107-826c-b811fd855918'} Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:38:47.342338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.343406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.345002 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Returning 404 to user: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:38:47.345002 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7c1df422-a90a-4c7c-a101-fb2ba096df70 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "DELETE /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 404 len: 111 microversion: 2.1 time: 0.041041 Aug 24 15:38:47.346534 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 78/152] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:38:47 2022] DELETE /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:38:47.353810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:47.354494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] [instance: 97b68fc0-0cf5-4107-826c-b811fd855918] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:47.363977 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:47.364515 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:47.364944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:47.365643 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:47.366265 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:47.366378 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:47.366711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:47.366853 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:47.373857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:47.374597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:47.375347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:47.376259 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:47.376900 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:47.377524 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:47.385673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] HTTP exception thrown: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Request method failure captured: Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 HTTP/1.1 Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkWyRjn_dYwHn7Eq4GnToC0LK3Du4VR0oYKpm5jKkhcFYNksDoq86cycyV_vBhYzBsRuTZFFLd-AFkXuJqH2SXN_Mmr5bSyKj2QMzu0lqBjKAXRgiWd4Xz0RaABZiL42Vp1g8v5Q-7K-gywBZ9nKTQuTFcyjWpNy9A8PHz_d9LzZ72c Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:38:47.387598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ee9eb7c5b5f94cd78546a3c1cc3d7cc7", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ee9eb7c5b5f94cd78546a3c1cc3d7cc7"}]}] Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: ee9eb7c5b5f94cd78546a3c1cc3d7cc7 Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027251854 Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: b490535729c64eaa8e89bf8eb8d56290 Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-DeleteServersTestJSON-2027251854-project Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.388783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '97b68fc0-0cf5-4107-826c-b811fd855918'} Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:38:47.389524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. Aug 24 15:38:47.390574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:38:47.391711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] Returning 404 to user: Instance 97b68fc0-0cf5-4107-826c-b811fd855918 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:38:47.391711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4ff4b862-2516-41d3-99f3-f25b33bcb6d7 tempest-DeleteServersTestJSON-2027251854 tempest-DeleteServersTestJSON-2027251854-project] 10.222.0.73 "GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918" status: 404 len: 111 microversion: 2.1 time: 0.039352 Aug 24 15:38:47.391711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 75/153] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:47 2022] GET /compute/v2.1/servers/97b68fc0-0cf5-4107-826c-b811fd855918 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:38:47.605484 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:47.614361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5c687f55-9d05-4174-a9be-c2106a567402 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.251838 Aug 24 15:38:47.615163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 79/154] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:47 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:48.635681 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:48.636344 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:48.654186 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:48.654846 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:48.655462 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:48.656182 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:48.656666 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:48.657379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:48.847858 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:48.881308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4a8276df-3bd7-487a-b980-16c0245569c4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.249234 Aug 24 15:38:48.894618 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 76/155] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:48 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:49.904913 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:49.905580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:49.910307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:49.926664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:49.948389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:49.949308 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:49.951204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:49.952888 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:49.954253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:50.309553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:50.343211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e498fc81-8ae3-4e64-862d-5ce537abe7f3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1520 microversion: 2.1 time: 0.440736 Aug 24 15:38:50.362231 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 80/156] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:49 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:51.371654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:51.372185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:51.381346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:51.381843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:51.382284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:51.383923 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:51.384729 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:51.384816 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:51.850849 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:51.880910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-83ef431d-8d1e-427a-99ea-d4b2497f4bd9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1500 microversion: 2.1 time: 0.504876 Aug 24 15:38:51.880910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 77/157] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:51 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1500 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:51.910120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:51.913698 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:51.927947 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:51.928456 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:51.928882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:51.929594 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:51.930050 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:51.930477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:51.934839 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:52.314573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:52.342508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c126c9bd-8f33-4d7d-bef1-3dd68445ceae tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1514 microversion: 2.1 time: 0.436428 Aug 24 15:38:52.343660 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 81/158] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:51 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:53.952283 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:53.955537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:53.962076 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:53.962663 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:53.963176 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:53.964125 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:53.964780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:53.965320 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:53.990011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lazy-loading 'flavor' on Instance uuid c9197f87-6b4b-48c3-82b6-291e3fa22b44 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:38:54.017150 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:54.077220 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7121387f-79e8-4aaf-99d7-e454dd482128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44/action" status: 200 len: 32 microversion: 2.1 time: 0.129670 Aug 24 15:38:54.078187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 78/159] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:38:53 2022] POST /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44/action => generated 32 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:38:54.096901 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:54.097537 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:54.107167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:54.107640 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:54.108149 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:54.109006 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:54.109521 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:54.110274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:54.270321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:54.280684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3e06017a-f697-4296-973b-e47fa633f5da tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.195507 Aug 24 15:38:54.286713 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 82/160] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:54 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:54.914815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-84beb35f-0e7e-470e-9b24-f0f73b65e89f tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Action: 'create', calling method: .version_select at 0x7f07837c1160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2104782939"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:55.308936 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:55.309586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:55.323333 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:55.326946 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:55.327435 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:55.330049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:55.330885 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:55.331329 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:55.373788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-84beb35f-0e7e-470e-9b24-f0f73b65e89f tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.705686 Aug 24 15:38:55.382250 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 79/161] 10.222.0.73 () {60 vars in 1155 bytes} [Wed Aug 24 15:38:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 708 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 15:38:55.389085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2d4fd868-0ef1-47ab-81cf-a53ecb0f29d8 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f079007cca0>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:55.481956 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2d4fd868-0ef1-47ab-81cf-a53ecb0f29d8 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898" status: 200 len: 345 microversion: 2.1 time: 0.097271 Aug 24 15:38:55.482686 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 80/162] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:38:55 2022] GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:38:55.536363 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:55.545445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-dea34f02-49b3-42ae-89d1-b8b57b0e3139 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.245342 Aug 24 15:38:55.546089 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 83/163] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:55 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:56.499763 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5c2a9916-3a7e-41de-9cc4-86b82aecd24c tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f079007c670>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:56.567806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:56.568425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:56.576285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5c2a9916-3a7e-41de-9cc4-86b82aecd24c tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898" status: 200 len: 346 microversion: 2.1 time: 0.080473 Aug 24 15:38:56.576855 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 81/164] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:38:56 2022] GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:56.593487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:56.593487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:56.593487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:56.593487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:56.594022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:56.594022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:56.595063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c742112c-1979-4a0a-9b1d-5e93960555c2 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Action: 'create', calling method: .version_select at 0x7f07901fc5e0>, body: {"snapshot": {"volume_id": "3c504655-4739-4df7-ae0d-f8911dedd898", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-215990472"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:56.787953 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:56.799365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1074f50d-7a96-415b-bb9f-b5dbda7728a5 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.235506 Aug 24 15:38:56.800056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 84/165] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:56 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:56.835192 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c742112c-1979-4a0a-9b1d-5e93960555c2 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.249110 Aug 24 15:38:56.836118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 82/166] 10.222.0.73 () {60 vars in 1162 bytes} [Wed Aug 24 15:38:56 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 15:38:56.849480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-80b6015c-a2ed-41f8-a942-ee3ff3862eeb tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f07909101f0>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:56.892068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-80b6015c-a2ed-41f8-a942-ee3ff3862eeb tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 200 len: 286 microversion: 2.1 time: 0.048662 Aug 24 15:38:56.892657 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 85/167] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 15:38:56 2022] GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:56.905158 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-690a03fe-3906-4d3a-8fb6-22c450217366 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f07901998b0>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:56.941335 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-690a03fe-3906-4d3a-8fb6-22c450217366 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.041409 Aug 24 15:38:56.941945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 83/168] 10.222.0.73 () {58 vars in 1140 bytes} [Wed Aug 24 15:38:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:56.953723 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2040a708-1efc-4247-9c24-bf882e6bc6b6 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f0790910820>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:57.018408 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2040a708-1efc-4247-9c24-bf882e6bc6b6 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 200 len: 286 microversion: 2.1 time: 0.068648 Aug 24 15:38:57.019167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 86/169] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 15:38:56 2022] GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:57.821389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:57.822416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:57.829784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:57.830276 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:57.830742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:57.831735 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:57.832429 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:57.832866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:57.977092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:57.991665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e12e81da-405d-4e9f-9bf1-5578005b09f1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.174678 Aug 24 15:38:57.992246 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 84/170] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:57 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:58.031390 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-55f65ed2-cefc-4137-bd25-4ab0782a9ce7 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f0790a17280>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:58.067191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-55f65ed2-cefc-4137-bd25-4ab0782a9ce7 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 200 len: 286 microversion: 2.1 time: 0.040063 Aug 24 15:38:58.067842 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 87/171] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 15:38:58 2022] GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:59.012934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:59.013533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:59.016877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=46 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:59.022149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:59.022628 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:59.023077 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:59.023765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:59.024215 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:59.024634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:59.082341 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d80cf530-fd78-4232-8793-340e86b11e70 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f079096fa60>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:59.146430 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d80cf530-fd78-4232-8793-340e86b11e70 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 200 len: 286 microversion: 2.1 time: 0.070238 Aug 24 15:38:59.147589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 88/172] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 15:38:59 2022] GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:38:59.169410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:59.178963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-612d7581-7aaa-4061-aa65-b5566ca4fe63 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.169754 Aug 24 15:38:59.188562 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 85/173] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:59 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:00.158854 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2ace0dcf-7be5-49d2-b39f-4346422cf5e0 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f0790910310>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:00.192755 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2ace0dcf-7be5-49d2-b39f-4346422cf5e0 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 200 len: 287 microversion: 2.1 time: 0.037877 Aug 24 15:39:00.193507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 89/174] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 15:39:00 2022] GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:00.204289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7f16ef7c-3d8a-44e1-82e8-c021bcb75149 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f0790910d30>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:00.204829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:00.205554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:00.214172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:00.214778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:00.215590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:00.216373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:00.216911 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:00.217628 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:00.273370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7f16ef7c-3d8a-44e1-82e8-c021bcb75149 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 202 len: 0 microversion: 2.1 time: 0.073140 Aug 24 15:39:00.278579 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 90/175] 10.222.0.73 () {58 vars in 1254 bytes} [Wed Aug 24 15:39:00 2022] DELETE /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:39:00.285160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-edda2326-b546-4f01-b77a-91523cc5f07a tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f0790a17790>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:00.336627 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-edda2326-b546-4f01-b77a-91523cc5f07a tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 200 len: 286 microversion: 2.1 time: 0.056000 Aug 24 15:39:00.337825 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 91/176] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 15:39:00 2022] GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:00.402424 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:00.416758 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-05e279ef-d480-4a8a-bf88-53adc16a63a8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.216594 Aug 24 15:39:00.417530 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 86/177] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:00 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:01.351490 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-61b97973-942e-4bd3-8ffe-7584cbd891b6 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f0790910ee0>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:01.383281 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-61b97973-942e-4bd3-8ffe-7584cbd891b6 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] HTTP exception thrown: Snapshot 00b8a801-5118-4599-b821-577b08ccef77 could not be found. Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-61b97973-942e-4bd3-8ffe-7584cbd891b6 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Request method failure captured: Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 HTTP/1.1 Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkYOf0UufNhwxwhOxYYxrDOZWrHZmQP5N6uX5ce6xF0lSbJRdwpxc-1w5A58N72mNlr9ckZbPeXVFAZeySC7Un8j8azYt9eBGgiLpHnAbX2UXYhSlBJXWpvKUG3QYhYaHcmxXj24PgcO7divDgs9Wv9_F8OtXGDV53lIeBSm0dFvIBk Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:39:01.386573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_947191f45d2749f6af46dc226da6ded6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/947191f45d2749f6af46dc226da6ded6"}]}] Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 82f70b90111f49ca859188da08044796 Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Snapshot 00b8a801-5118-4599-b821-577b08ccef77 could not be found. Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '00b8a801-5118-4599-b821-577b08ccef77'} Aug 24 15:39:01.388459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 00b8a801-5118-4599-b821-577b08ccef77 could not be found. (HTTP 404) (Request-ID: req-f83afd1a-03e9-4207-aefd-f5577a7d9e13) Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:01.389368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:39:01.390571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 00b8a801-5118-4599-b821-577b08ccef77 could not be found. Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 15:39:01.391894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 00b8a801-5118-4599-b821-577b08ccef77 could not be found. Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 00b8a801-5118-4599-b821-577b08ccef77 could not be found. Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-61b97973-942e-4bd3-8ffe-7584cbd891b6 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Returning 404 to user: Snapshot 00b8a801-5118-4599-b821-577b08ccef77 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:39:01.393194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-61b97973-942e-4bd3-8ffe-7584cbd891b6 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77" status: 404 len: 111 microversion: 2.1 time: 0.041719 Aug 24 15:39:01.394105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 92/178] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 15:39:01 2022] GET /compute/v2.1/os-snapshots/00b8a801-5118-4599-b821-577b08ccef77 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:39:01.402481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b6ba09c0-97a3-4193-8f67-86001be44fbc tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f07837c7670>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:01.441079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:01.441837 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:01.449707 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:01.450272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:01.450845 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:01.451642 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:01.452132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:01.453092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:01.472257 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b6ba09c0-97a3-4193-8f67-86001be44fbc tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898" status: 202 len: 0 microversion: 2.1 time: 0.073540 Aug 24 15:39:01.472891 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 87/179] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:39:01 2022] DELETE /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:39:01.481718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8dbfd559-0810-451d-ac97-4b14aa5a49df tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f07837e3af0>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:01.533458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8dbfd559-0810-451d-ac97-4b14aa5a49df tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898" status: 200 len: 345 microversion: 2.1 time: 0.055955 Aug 24 15:39:01.534115 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 88/180] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:39:01 2022] GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:39:01.617605 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:01.626902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-97a59b17-a19b-405e-9404-12a0d3434ad0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.190719 Aug 24 15:39:01.627698 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 93/181] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:01 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:02.548338 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-289cd7ec-59d3-4ebd-bd0d-dac8d7db502b tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f07837fb790>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:02.577015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-289cd7ec-59d3-4ebd-bd0d-dac8d7db502b tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] HTTP exception thrown: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-289cd7ec-59d3-4ebd-bd0d-dac8d7db502b tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Request method failure captured: Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 HTTP/1.1 Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkYOf0UufNhwxwhOxYYxrDOZWrHZmQP5N6uX5ce6xF0lSbJRdwpxc-1w5A58N72mNlr9ckZbPeXVFAZeySC7Un8j8azYt9eBGgiLpHnAbX2UXYhSlBJXWpvKUG3QYhYaHcmxXj24PgcO7divDgs9Wv9_F8OtXGDV53lIeBSm0dFvIBk Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:39:02.581527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_947191f45d2749f6af46dc226da6ded6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/947191f45d2749f6af46dc226da6ded6"}]}] Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 82f70b90111f49ca859188da08044796 Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '3c504655-4739-4df7-ae0d-f8911dedd898'} Aug 24 15:39:02.583160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. (HTTP 404) (Request-ID: req-c9f8d576-f47a-4a24-ad79-52cb8acfcbf8) Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.584084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:39:02.585704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:39:02.587200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-289cd7ec-59d3-4ebd-bd0d-dac8d7db502b tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Returning 404 to user: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-289cd7ec-59d3-4ebd-bd0d-dac8d7db502b tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898" status: 404 len: 109 microversion: 2.1 time: 0.039475 Aug 24 15:39:02.591776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 89/182] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:39:02 2022] GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:39:02.601170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2b970151-c358-4da6-893d-119953050d0a tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f07909103a0>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:02.628697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-2b970151-c358-4da6-893d-119953050d0a tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] HTTP exception thrown: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2b970151-c358-4da6-893d-119953050d0a tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Request method failure captured: Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 HTTP/1.1 Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkYOf0UufNhwxwhOxYYxrDOZWrHZmQP5N6uX5ce6xF0lSbJRdwpxc-1w5A58N72mNlr9ckZbPeXVFAZeySC7Un8j8azYt9eBGgiLpHnAbX2UXYhSlBJXWpvKUG3QYhYaHcmxXj24PgcO7divDgs9Wv9_F8OtXGDV53lIeBSm0dFvIBk Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:39:02.631052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_947191f45d2749f6af46dc226da6ded6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/947191f45d2749f6af46dc226da6ded6"}]}] Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 82f70b90111f49ca859188da08044796 Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '3c504655-4739-4df7-ae0d-f8911dedd898'} Aug 24 15:39:02.632464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. (HTTP 404) (Request-ID: req-2965160c-4ae6-4dbd-b265-37c8653f2e98) Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.633293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:39:02.634527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:39:02.636211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2b970151-c358-4da6-893d-119953050d0a tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Returning 404 to user: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2b970151-c358-4da6-893d-119953050d0a tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898" status: 404 len: 109 microversion: 2.1 time: 0.035056 Aug 24 15:39:02.639105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 94/183] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:39:02 2022] DELETE /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:39:02.641747 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-87bf68a4-8d90-4e39-9260-476f260e2a32 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Calling method '.version_select at 0x7f07837e3c10>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:02.649298 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:02.652292 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:02.660011 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:02.660504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:02.660935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:02.661987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:02.662851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:02.663624 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:02.676838 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-87bf68a4-8d90-4e39-9260-476f260e2a32 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] HTTP exception thrown: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-87bf68a4-8d90-4e39-9260-476f260e2a32 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Request method failure captured: Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 HTTP/1.1 Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkYOf0UufNhwxwhOxYYxrDOZWrHZmQP5N6uX5ce6xF0lSbJRdwpxc-1w5A58N72mNlr9ckZbPeXVFAZeySC7Un8j8azYt9eBGgiLpHnAbX2UXYhSlBJXWpvKUG3QYhYaHcmxXj24PgcO7divDgs9Wv9_F8OtXGDV53lIeBSm0dFvIBk Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:39:02.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_947191f45d2749f6af46dc226da6ded6", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/947191f45d2749f6af46dc226da6ded6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/947191f45d2749f6af46dc226da6ded6"}]}] Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 947191f45d2749f6af46dc226da6ded6 Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1925604747 Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 82f70b90111f49ca859188da08044796 Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1925604747-project Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '3c504655-4739-4df7-ae0d-f8911dedd898'} Aug 24 15:39:02.681475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. (HTTP 404) (Request-ID: req-64ef533c-20e0-425e-ba14-d3c068d7fbee) Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.683814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:39:02.686463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:39:02.689306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-87bf68a4-8d90-4e39-9260-476f260e2a32 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] Returning 404 to user: Volume 3c504655-4739-4df7-ae0d-f8911dedd898 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-87bf68a4-8d90-4e39-9260-476f260e2a32 tempest-VolumesSnapshotsTestJSON-1925604747 tempest-VolumesSnapshotsTestJSON-1925604747-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898" status: 404 len: 109 microversion: 2.1 time: 0.043410 Aug 24 15:39:02.691296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 90/184] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:39:02 2022] GET /compute/v2.1/os-volumes/3c504655-4739-4df7-ae0d-f8911dedd898 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:39:02.826016 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:02.838053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3c44f19e-07a4-4a75-a132-d7bbf7201817 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.192711 Aug 24 15:39:02.838666 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 95/185] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:02 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:03.864650 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:03.865668 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:03.872534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:03.873127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:03.873679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:03.874510 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:03.875293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:03.875932 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:04.046092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:04.055632 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-deaf2f4a-2bea-496e-a2fa-4c4a0b96253e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.195055 Aug 24 15:39:04.056225 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 91/186] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:03 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:05.080257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:05.080867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:05.087338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:05.088138 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:05.088893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:05.090112 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:05.091003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:05.091780 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:05.227100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:05.235019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5d907f52-bdb0-41ab-ac45-49caa6cb8bc7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.158918 Aug 24 15:39:05.236059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 96/187] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:05 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:05.415044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:05.415673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:05.421943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:05.422427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:05.422889 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:05.423615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:05.424101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:05.424538 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:05.449453 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-60de8fcf-8d9a-4445-a6fa-37cb41c6365b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/ips" status: 200 len: 144 microversion: 2.1 time: 0.038406 Aug 24 15:39:05.450010 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 92/188] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:39:05 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:06.256778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:06.257384 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:06.263388 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:06.263870 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:06.264304 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:06.264991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:06.266056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:06.266496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:06.399931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:06.407636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-eae1eaf3-85bf-4532-b1d5-c7eddad7f4ca tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.154888 Aug 24 15:39:06.408239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 97/189] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:06 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:07.429252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:07.429857 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:07.436295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:07.436780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:07.437769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:07.438488 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:07.439000 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:07.439477 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:07.567538 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:07.575589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-63f56084-8373-4d64-a7c9-6aca2a9c3e5b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.150082 Aug 24 15:39:07.576070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 93/190] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:07 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:08.598187 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:08.598746 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:08.604808 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:08.605293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:08.605728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:08.606414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:08.606904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:08.607325 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:08.748597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:08.756830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d4b37230-a10f-476b-9070-19d72a0c2715 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.163470 Aug 24 15:39:08.757397 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 98/191] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:08 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:08.913618 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:08.914109 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:08.922381 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:08.923297 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:08.923799 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:08.924510 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:08.924969 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:08.925389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:08.951710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-697cc06b-9fb4-4912-8ca2-42b2f975a5a1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/ips" status: 200 len: 148 microversion: 2.1 time: 0.041768 Aug 24 15:39:08.952605 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 94/192] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:39:08 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:09.307782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ed52da5-86bd-4da0-bfd8-fddeaa567190"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:09.310280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:09.317347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:09.318086 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:09.318581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:09.319521 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:09.320157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:09.320759 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:09.665992 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cf876700-6efc-474e-ba1e-d5d816acb12a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363559 Aug 24 15:39:09.667150 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 99/193] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:39:09 2022] POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:39:09.779347 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:09.780186 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:09.790625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:09.791148 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:09.791580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:09.792277 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:09.792724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:09.793320 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:09.940178 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:09.947859 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a8c7f5c7-55ac-4fbb-a3ed-079e68a1548a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.173088 Aug 24 15:39:09.948431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 95/194] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:09 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:10.458378 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10549d70-5fa0-4493-8639-741be82396da"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:10.461029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:10.467466 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:10.467931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:10.468381 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:10.469088 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:10.469536 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:10.470100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:10.969019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:10.969767 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:10.977285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:10.977762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:10.978195 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:10.978906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:10.979365 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:10.979785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:11.109024 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:11.116980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-78abcd1c-a5e4-4035-b76d-425b36ec190f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.151828 Aug 24 15:39:11.117559 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 96/195] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:10 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:12.137706 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:12.138365 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:12.145603 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:12.146087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:12.146524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:12.147250 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:12.147757 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:12.148132 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:12.485674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:12.493517 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-66fa4c6a-9aac-4fe2-9b2d-3c79e86d85a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.359785 Aug 24 15:39:12.494096 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 97/196] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:12 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:12.834110 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5cb02e99-e07d-4f25-ae9d-017a3126d314 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.381359 Aug 24 15:39:12.834851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 100/197] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:39:10 2022] POST /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments => generated 194 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:13.514809 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:13.515425 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:13.522094 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:13.522577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:13.523059 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:13.523783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:13.524246 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:13.524673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:13.660970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:13.668617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ac245099-c3d2-4cdb-b736-919ffae8b535 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.157808 Aug 24 15:39:13.669252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 98/198] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:13 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:14.691899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:14.692552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:14.698771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:14.699251 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:14.699682 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:14.700365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:14.700878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:14.701296 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:14.834810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:14.842410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c22ab2aa-be1c-48d1-be3a-9f2df0e4a9b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.156140 Aug 24 15:39:14.843006 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 101/199] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:14 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:15.864499 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:15.865104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:15.871766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:15.872249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:15.872682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:15.873383 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:15.873835 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:15.874256 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:16.162725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:16.170583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-aa46b5f3-2f77-4d44-8098-4efde2fe0aff tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.310683 Aug 24 15:39:16.171199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 99/200] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:15 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:17.202860 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:17.202860 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:17.210822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:17.211941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:17.212635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:17.213485 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:17.214052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:17.214787 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:17.374540 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:17.382434 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4354ab09-459b-4334-b84f-6f0c1451886a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.189861 Aug 24 15:39:17.383411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 102/201] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:17 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:18.405662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:18.405662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:18.417460 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:18.418786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:18.419938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:18.428309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:18.429025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:18.429676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:18.575523 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:18.583821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3ac40dc1-fde3-43f4-beab-26e8e9296839 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.184277 Aug 24 15:39:18.584806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 100/202] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:18 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:19.605686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:19.606295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:19.612792 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.613274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.613711 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:19.614400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.614923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.615348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:19.748696 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:19.757370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6f6a066c-b1f4-4a52-b47f-f28c3ef7eee8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1500 microversion: 2.1 time: 0.155554 Aug 24 15:39:19.758084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 103/203] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:19 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:19.780713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe8f8de1-5e65-4dfb-98c0-ea5bd4d10c20"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:19.784086 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:19.792322 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.792880 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.793444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:19.794201 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.794671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.795104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:19.821652 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] HTTP exception thrown: Cannot 'attach_volume' instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 while it is in vm_state rescued Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Request method failure captured: Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: POST /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44/os-volume_attachments HTTP/1.1 Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 74 Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5CZt0tAlR3mpFR4ggVXXsyZBdFuqvdWobkUmWkxTjTRtSDtWM9_GQyWYV6ysWKWS443Z7qgWdmOM3dWNy8gtlL03uN_kM2Q37BeuiXM6LlrsK3kP9qzaBe69YpoNR5Ru0sqJnrd5A2-7UiTCtqDB6WyTMwmEMfFY1vZEtgUhvYJk Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:39:19.823640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d204b26857042e397b91be285fa3ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d204b26857042e397b91be285fa3ed9"}]}] Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 4dd615d7af7741b08cc44b6c983fae49 Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {"volumeAttachment": {"volumeId": "fe8f8de1-5e65-4dfb-98c0-ea5bd4d10c20"}} Aug 24 15:39:19.825134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Cannot 'attach_volume' instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 while it is in vm_state rescued Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'server_id': 'c9197f87-6b4b-48c3-82b6-291e3fa22b44', 'body': {'volumeAttachment': {'volumeId': 'fe8f8de1-5e65-4dfb-98c0-ea5bd4d10c20'}}} Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:39:19.825802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 while it is in vm_state rescued Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:19.826853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:19.827945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:39:19.827945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:39:19.827945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 while it is in vm_state rescued Aug 24 15:39:19.827945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:39:19.827945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Returning 409 to user: Cannot 'attach_volume' instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 while it is in vm_state rescued {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:39:19.827945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f1bfa999-dad1-4295-b168-77e7498c4a23 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049973 Aug 24 15:39:19.827945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 101/204] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:39:19 2022] POST /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:39:19.834840 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:19.835364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:19.844978 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.845887 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.846480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:19.847482 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.847933 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.848350 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:19.852929 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:19.946197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c23e63d2-6532-4af4-bc9c-fa43abfd4128 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44/action" status: 202 len: 0 microversion: 2.1 time: 0.114997 Aug 24 15:39:19.950208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 104/205] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:39:19 2022] POST /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:39:19.961501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:19.962475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:19.968729 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.969510 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.970692 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:19.971732 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:19.972663 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:19.973305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:20.137830 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:20.147062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f6eda9d5-4548-4bc5-aa82-a0f35cf0a7f7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1508 microversion: 2.1 time: 0.195641 Aug 24 15:39:20.147902 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 102/206] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:19 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:20.507295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f27bd1b1-0ded-41e7-8c41-75482f63e75f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:20.518007 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=32 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:20.520935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27bd1b1-0ded-41e7-8c41-75482f63e75f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:20.521499 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27bd1b1-0ded-41e7-8c41-75482f63e75f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:20.521918 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27bd1b1-0ded-41e7-8c41-75482f63e75f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:20.633696 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f27bd1b1-0ded-41e7-8c41-75482f63e75f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Going to try to stop instance {{(pid=132289) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 15:39:20.704401 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f27bd1b1-0ded-41e7-8c41-75482f63e75f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action" status: 202 len: 0 microversion: 2.1 time: 0.205506 Aug 24 15:39:20.708981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 105/207] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:39:20 2022] POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:39:20.713747 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:20.714531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:20.724909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:20.725962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:20.726687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:20.727901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:20.728878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:20.729171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:20.926810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:20.936069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5b302ae3-7b69-4371-94b8-fcf501017ad4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.226120 Aug 24 15:39:20.936871 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 103/208] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:20 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:21.174937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:21.175636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:21.182402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:21.183083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:21.183593 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:21.184287 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:21.184730 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:21.185414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:21.333053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:21.341183 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2129c82f-8de0-4b50-a600-b4a598ddecbe tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1508 microversion: 2.1 time: 0.171115 Aug 24 15:39:21.341780 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 106/209] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:21 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:21.958579 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:21.959275 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:21.965660 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:21.966147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:21.966589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:21.967318 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:21.967773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:21.968208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:21.973093 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:22.160925 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:22.179315 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-be3998b7-d56c-4f6d-9ed4-bc30c6f2682a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.224543 Aug 24 15:39:22.193537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 104/210] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:21 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:22.363238 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:22.363771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:22.370183 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:22.370684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:22.371267 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:22.371953 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:22.372568 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:22.372993 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:22.584052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:22.599530 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-fb1d664c-d767-4fcc-ab58-979651d3e785 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1508 microversion: 2.1 time: 0.240339 Aug 24 15:39:22.601171 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 107/211] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:22 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:23.201740 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:23.202316 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:23.211815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:23.212332 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:23.212832 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:23.213619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:23.213953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:23.214762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:23.372346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:23.382157 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3e7f534f-2079-43e9-abb2-5b7a55856be0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.184609 Aug 24 15:39:23.395276 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 105/212] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:23 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:23.622771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:23.623310 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:23.629564 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:23.630222 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:23.631066 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:23.631757 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:23.632363 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:23.632911 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:23.785577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:23.794110 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-dc2c88a7-c577-4935-96bb-61ae840d3051 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1514 microversion: 2.1 time: 0.175263 Aug 24 15:39:23.798022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 108/213] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:23 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:24.404200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:24.404711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:24.411864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:24.412349 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:24.412784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:24.413479 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:24.413929 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:24.414348 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:24.546734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:24.554967 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3c5496a7-88fe-4923-887f-f7c9811af58a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.154735 Aug 24 15:39:24.555531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 106/214] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:24 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:25.483128 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8aea1896-7d6a-403d-ad82-5f0494b9868b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'create', calling method: .version_select at 0x7f0790890a60>, body: {"keypair": {"name": "tempest-keypair-505483707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD345Z2UmJbdxDSIkEe7JrVBcCwNsljYOGEis8QpyWHDrFYKoyXJEQWB83TOV3VwNzyIk14ACA0aaVM7HVWeSe/q832JovxnuuGA/iydf1REJK+ma1MbyoeWnn+O3mAL9w=="}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:25.505882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-8aea1896-7d6a-403d-ad82-5f0494b9868b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for project 3d204b26857042e397b91be285fa3ed9. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:39:25.509701 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-8aea1896-7d6a-403d-ad82-5f0494b9868b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for user 4dd615d7af7741b08cc44b6c983fae49 and project 3d204b26857042e397b91be285fa3ed9. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:39:25.550889 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8aea1896-7d6a-403d-ad82-5f0494b9868b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071449 Aug 24 15:39:25.551486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 109/215] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:39:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:25.576971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:25.577953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:25.586711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:25.587418 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:25.587887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:25.588556 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:25.589019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:25.589489 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:25.820708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:25.829037 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4a8c3dae-640b-40c4-b0df-776d61d8050e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.256695 Aug 24 15:39:25.829848 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 107/216] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:25 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:26.849886 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:26.850520 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:26.857040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:26.857524 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:26.857960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:26.858671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:26.859143 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:26.859570 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:26.999307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:27.008573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-82b24f83-5526-4f72-815d-6fe4530852ae tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.162828 Aug 24 15:39:27.009158 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 110/217] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:26 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:27.011813 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-793302500", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb9d3cc4-b6ec-44e7-98b4-28d29d6a6c5a"}], "security_groups": [{"name": "tempest-securitygroup--1757112242"}], "key_name": "tempest-keypair-505483707", "user_data": "}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:27.115807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] validate_networks() for [('eb9d3cc4-b6ec-44e7-98b4-28d29d6a6c5a', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:39:27.489078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:39:27.489500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:39:27.489996 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:39:27.490396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:39:27.490842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:39:27.499567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:27.500041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:27.500466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:27.501220 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:27.501665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:27.502081 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:27.519002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for project 3d204b26857042e397b91be285fa3ed9. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:39:27.522921 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Getting quotas for user 4dd615d7af7741b08cc44b6c983fae49 and project 3d204b26857042e397b91be285fa3ed9. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:39:27.534539 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:39:27.536904 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:39:27.583282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7ef47098-1099-4b9d-b29d-a33c34138afc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.576244 Aug 24 15:39:27.583926 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 108/218] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:39:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:39:27.595225 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ea565859-08f1-4bbb-bec6-fc6986639e8a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:27.596065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ea565859-08f1-4bbb-bec6-fc6986639e8a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:27.648289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ea565859-08f1-4bbb-bec6-fc6986639e8a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:27.655338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ea565859-08f1-4bbb-bec6-fc6986639e8a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1244 microversion: 2.1 time: 0.064526 Aug 24 15:39:27.655903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 111/219] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:27 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1244 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:28.029991 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:28.030730 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:28.038250 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:28.038786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:28.039229 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:28.040044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:28.040526 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:28.040978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:28.180034 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:28.188219 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-829e25ea-8598-4b03-b247-ec635312418c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.162743 Aug 24 15:39:28.189510 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 109/220] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:28 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:28.677179 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:28.677767 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:28.684711 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:28.685181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:28.685605 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:28.686275 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:28.686746 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:28.687163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:28.752471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:28.760802 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a80aa250-d6f1-46cd-874f-4a178b981a67 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1248 microversion: 2.1 time: 0.087977 Aug 24 15:39:28.761379 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 112/221] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:28 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:29.211171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:29.211806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:29.214188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:29.220546 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:29.221227 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:29.221676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:29.222657 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:29.223133 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:29.223564 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:29.443341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:29.454614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a863543a-ccf4-4956-90b8-e9b5e37d8170 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.249081 Aug 24 15:39:29.456127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 110/222] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:29 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:29.781291 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:29.781909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:29.789730 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:29.790467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:29.791150 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:29.792046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:29.792799 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:29.793413 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:29.882264 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:29.895524 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-35cc046f-51cf-4809-99cd-1f648f92ad07 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1296 microversion: 2.1 time: 0.117932 Aug 24 15:39:29.896972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 113/223] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:29 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:30.010563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1dedf7f6-5719-4c72-abb3-41612d480e1f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: .version_select at 0x7f07837c1310>, body: {"keypair": {"name": "tempest-keypair-435109361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg2eUxKdfh35KXPP7l9nEqsAmeJssWtBsIqUWPegSmVapFHg3s0X2uqRwbEkdrSS73bFAuNZmgkrqugDtSS46u30KSyxwNOzfxXNBgnwKeKFO69XF/BvBJea+Kmmukj3A=="}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:30.038615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1dedf7f6-5719-4c72-abb3-41612d480e1f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:39:30.042855 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1dedf7f6-5719-4c72-abb3-41612d480e1f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:39:30.070072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1dedf7f6-5719-4c72-abb3-41612d480e1f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063690 Aug 24 15:39:30.070810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 111/224] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:39:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:30.477867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:30.478508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:30.485422 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:30.485910 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:30.486624 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:30.487343 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:30.487975 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:30.488394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:30.712688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:30.724462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4718d80f-bd5d-43d1-9aab-4a899010ac9f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.250443 Aug 24 15:39:30.725251 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 114/225] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:30 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:30.919221 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:30.919964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:30.927648 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:30.928365 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:30.928800 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:30.929675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:30.930416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:30.930955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:31.007235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:31.019601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-dd4c48c1-9bb3-4dcd-86ec-4c44799d3fa0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1314 microversion: 2.1 time: 0.105557 Aug 24 15:39:31.020175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 112/226] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:30 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1314 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:31.747024 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:31.748778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:31.756742 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:31.757459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:31.758076 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:31.760385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:31.761063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:31.761731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:31.785619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-909524406", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105210c5-8b78-4e8c-bd12-9456d560212d"}], "security_groups": [{"name": "tempest-securitygroup--1003474412"}], "key_name": "tempest-keypair-435109361", "user_data": "}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:31.949390 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] validate_networks() for [('105210c5-8b78-4e8c-bd12-9456d560212d', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:39:31.952928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:31.963450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bd61f7b4-2440-4fb1-bd59-d0bcd67f81c1 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.220879 Aug 24 15:39:31.964032 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 115/227] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:31 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:32.040685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:32.041401 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:32.048440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:32.049068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:32.049678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:32.050512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:32.051117 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:32.051639 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:32.311498 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:32.323709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6e6403bc-2875-4192-aaf9-235fca0de355 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1314 microversion: 2.1 time: 0.286612 Aug 24 15:39:32.331755 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 116/228] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:32 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:32.621670 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:39:32.622089 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:39:32.622587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:39:32.623028 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:39:32.623435 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:39:32.631974 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:32.632449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:32.632878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:32.633594 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:32.634044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:32.634461 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:32.651472 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:39:32.655206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:39:32.666797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:39:32.668904 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:39:32.717813 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-700977ce-227e-49ef-bc1e-2a23b9d032fe tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.937983 Aug 24 15:39:32.718600 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 113/229] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:39:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:39:32.730363 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2c4bc44d-cf68-4d71-92b3-e575f62b9fce tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:32.731062 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2c4bc44d-cf68-4d71-92b3-e575f62b9fce tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:32.794515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2c4bc44d-cf68-4d71-92b3-e575f62b9fce tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:32.805332 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2c4bc44d-cf68-4d71-92b3-e575f62b9fce tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1240 microversion: 2.1 time: 0.078534 Aug 24 15:39:32.806524 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 117/230] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:32 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:32.986155 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:32.987375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:32.994738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:32.995172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:32.995654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:32.996316 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:32.996774 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:32.997206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:33.265714 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:33.275353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2d306379-cdc4-4688-b45c-2ee18c740f7e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.293125 Aug 24 15:39:33.275944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 114/231] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:32 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:33.357806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:33.358417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:33.369663 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:33.370160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:33.370947 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:33.371664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:33.372125 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:33.372575 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:33.449966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:33.459125 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-801ef250-fae7-449a-a96c-96eda7386536 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1302 microversion: 2.1 time: 0.105103 Aug 24 15:39:33.459693 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 118/232] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:33 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:33.460261 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2078428544", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "networks": [{"uuid": "cc385d41-488b-42c2-8d03-cfd468490140"}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:33.521669 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] validate_networks() for [('cc385d41-488b-42c2-8d03-cfd468490140', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:39:33.845386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:33.846005 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:33.852685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:33.853177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:33.853614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:33.854456 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:33.854847 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:33.855312 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:34.003322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:34.027841 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e06dced9-f698-46b7-91b8-44324d74beac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1236 microversion: 2.1 time: 0.185585 Aug 24 15:39:34.044581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 119/233] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:33 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1236 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:34.281788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:39:34.282344 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:39:34.282835 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:39:34.284025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:39:34.284445 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:39:34.295440 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:34.296063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:34.296589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:34.297395 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:34.297933 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:34.298427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:34.298557 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:34.299239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:34.311862 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:34.312907 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:34.314168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:34.316155 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:34.317404 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:34.318341 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:34.328516 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Getting quotas for project df1ee75d012f4378a607020154eaf0b4. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:39:34.334600 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Getting quotas for user ff886c5f2516476e85e9e805aa19fece and project df1ee75d012f4378a607020154eaf0b4. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:39:34.350806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:39:34.353561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:39:34.406756 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9b7e19fd-f29d-4723-9c1c-6f07912918fb tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952184 Aug 24 15:39:34.407834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 115/234] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:39:34.421766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-28a11883-e10e-4dae-81a1-380aa57f5d5c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:34.422558 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-28a11883-e10e-4dae-81a1-380aa57f5d5c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:34.541861 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-28a11883-e10e-4dae-81a1-380aa57f5d5c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:34.579268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-28a11883-e10e-4dae-81a1-380aa57f5d5c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1214 microversion: 2.1 time: 0.162613 Aug 24 15:39:34.581997 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 116/235] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:34 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:34.610077 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:34.611087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:34.613989 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:34.621973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:34.622494 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4a6e578b-c9fd-4988-b3ba-e9a4b25ccff7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.329165 Aug 24 15:39:34.623612 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:34.624501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:34.627123 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:34.627935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 120/236] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:34 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:34.628772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:34.629528 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:34.936002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:34.944743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4d4d3810-5bbd-47dd-a8a3-ef4d2f1be7b7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.345896 Aug 24 15:39:34.945357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 117/237] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:34 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:35.051599 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:35.053398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:35.060864 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.062166 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.062828 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.063715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.077163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.078112 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.208655 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:35.216331 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:35.227496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c4adba22-a588-4977-bcaa-6f57f1236113 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1298 microversion: 2.1 time: 0.181941 Aug 24 15:39:35.234945 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 121/238] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:35 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:35.287531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-9283af4e-e13e-4faf-9cf2-1d77d1b4f193 req-7fde0162-4b1f-4baf-86ad-cb0c35a24031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd8a365-ce5e-405e-8b76-93303538f94e", "tag": "d30bf2eb-be05-4025-9994-339e033189d7"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:35.309003 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9283af4e-e13e-4faf-9cf2-1d77d1b4f193 req-7fde0162-4b1f-4baf-86ad-cb0c35a24031 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.313518 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9283af4e-e13e-4faf-9cf2-1d77d1b4f193 req-7fde0162-4b1f-4baf-86ad-cb0c35a24031 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.314149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9283af4e-e13e-4faf-9cf2-1d77d1b4f193 req-7fde0162-4b1f-4baf-86ad-cb0c35a24031 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.344458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-9283af4e-e13e-4faf-9cf2-1d77d1b4f193 req-7fde0162-4b1f-4baf-86ad-cb0c35a24031 service nova] Creating event network-changed:d30bf2eb-be05-4025-9994-339e033189d7 for instance 8dd8a365-ce5e-405e-8b76-93303538f94e on hv-cinder-84605 Aug 24 15:39:35.359471 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-9283af4e-e13e-4faf-9cf2-1d77d1b4f193 req-7fde0162-4b1f-4baf-86ad-cb0c35a24031 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076214 Aug 24 15:39:35.360087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 118/239] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:35.609741 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:35.610389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:35.617608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.618129 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.618566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.619452 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.620061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.620489 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.653715 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:35.656220 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:35.675517 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.676128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.676631 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.680962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.681597 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.688034 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.729613 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:35.738845 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0eeddb56-a0e3-46a5-80e5-eb69ab67d03a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1266 microversion: 2.1 time: 0.133782 Aug 24 15:39:35.739757 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 122/240] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:35 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:35.968593 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:35.969570 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:35.984815 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.986327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.989757 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:35.990698 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:35.991321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:35.993899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.025543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:36.046203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-16061208-012b-426a-b281-17af9baeb1bf tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.399334 Aug 24 15:39:36.047143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 119/241] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:35 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:36.258081 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:36.259004 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:36.262757 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:36.266342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.267079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:36.268291 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.269182 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.269781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:36.270248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.275056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-33b68ba5-d8df-4abf-a1ce-77b43b966b55 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.310301 Aug 24 15:39:36.275722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 123/242] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:35 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:36.459921 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-974d62cf-d4e9-4494-8e2a-15d9735ff5ad req-01951b71-f577-4364-9097-020294011463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f35f56-4bfe-416c-861e-c49c02f623c2", "tag": "5a903b96-7262-4382-b289-851e17d994de"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:36.479026 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-974d62cf-d4e9-4494-8e2a-15d9735ff5ad req-01951b71-f577-4364-9097-020294011463 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.480110 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-974d62cf-d4e9-4494-8e2a-15d9735ff5ad req-01951b71-f577-4364-9097-020294011463 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:36.480878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-974d62cf-d4e9-4494-8e2a-15d9735ff5ad req-01951b71-f577-4364-9097-020294011463 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.509097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-974d62cf-d4e9-4494-8e2a-15d9735ff5ad req-01951b71-f577-4364-9097-020294011463 service nova] Creating event network-changed:5a903b96-7262-4382-b289-851e17d994de for instance f7f35f56-4bfe-416c-861e-c49c02f623c2 on hv-cinder-84605 Aug 24 15:39:36.518318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-974d62cf-d4e9-4494-8e2a-15d9735ff5ad req-01951b71-f577-4364-9097-020294011463 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062093 Aug 24 15:39:36.519752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 124/243] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:36.633783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:36.642230 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-472039ef-3162-4c51-9928-2991258fb9f4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.388674 Aug 24 15:39:36.646677 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 120/244] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:36 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:36.763305 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:36.763869 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:36.771123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.771709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:36.772213 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.773000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.773537 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:36.774035 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.851048 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:36.861088 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-76cc9871-add0-4364-9ec7-7aeb5d97f83e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1272 microversion: 2.1 time: 0.102024 Aug 24 15:39:36.862229 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 125/245] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:36 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:37.068550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:37.069413 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:37.075757 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.076341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.076782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.077486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.077946 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.078370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.285426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:37.295598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-48cbb908-d1d4-442e-ac59-d21a2e972bd3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.231168 Aug 24 15:39:37.297991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:37.299567 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:37.311016 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 121/246] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:37 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:37.316103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.316683 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.317198 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.317924 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.318445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.319601 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.506967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:37.514633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-394fc297-c8fe-42d1-956b-3e2b1993eaa7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.221079 Aug 24 15:39:37.515225 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 126/247] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:37 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:37.665007 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:37.665520 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:37.672240 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.672725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.673160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.673948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.674508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.675058 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.807827 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:37.816106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-55e94d40-80bd-4d78-bcb3-50760add63cd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.155129 Aug 24 15:39:37.816676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 122/248] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:37 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:37.883111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:37.883726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:37.889637 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.890119 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.890549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.891275 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:37.891730 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.892175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.038896 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:38.047504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d5144a5b-f894-4442-b47b-3e6ffbe3aa07 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.168097 Aug 24 15:39:38.048282 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 127/249] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:37 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:38.320799 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:38.321989 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:38.333483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.334178 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.334782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.335601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.336163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.336630 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.502674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:38.511666 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e0a76f35-fccc-4fed-9676-56b5c54b6b3b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.195455 Aug 24 15:39:38.512428 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 123/250] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:38 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:38.535816 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:38.536571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:38.543076 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.543565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.544003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.544702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.545163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.545586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.677218 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:38.685576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f107fd9c-6a9c-43a8-a3be-db206df8a6b3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.153556 Aug 24 15:39:38.686141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 128/251] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:38 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:38.836774 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:38.837376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:38.844028 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.844511 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.844946 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.845676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.846267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.846801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.994533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:39.002527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cd77cee4-e259-436f-9874-5b776277a4e0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.169709 Aug 24 15:39:39.003143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 124/252] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:38 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:39.069248 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:39.069887 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:39.076085 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.076560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.076991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.077673 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.078119 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.078539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.212835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:39.221626 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-83741016-cbd3-45b2-b398-bd8133370bc3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.156098 Aug 24 15:39:39.222224 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 129/253] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:39 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:39.533872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:39.534520 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:39.540490 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.540970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.541407 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.542102 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.542588 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.543052 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.561199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=100 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:39.673230 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:39.681908 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9d26b7ec-632d-4be6-a8df-180374f0b31c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1722 microversion: 2.1 time: 0.152429 Aug 24 15:39:39.682487 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 125/254] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:39 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:39.718758 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:39.719553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:39.726983 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.727567 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.728120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.729124 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.729688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.730113 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.866670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:39.874477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-35e94810-6e5b-405a-8844-54cb738bc43b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.160024 Aug 24 15:39:39.875082 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 130/255] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:39 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:40.023207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:40.023821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:40.030379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.030907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.031342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.032030 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.032483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.032904 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.162868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:40.170569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0d8b1855-9968-44d7-9a7a-279f4ee05840 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.151267 Aug 24 15:39:40.171185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 126/256] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:40 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:40.258177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:40.258981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:40.273517 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.274512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.275328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.276080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.276713 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.277149 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.627620 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:40.637769 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6c5ff043-ecb3-4172-8b8e-5235f3cd234a tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.398551 Aug 24 15:39:40.638630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 131/257] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:40 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:40.704091 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:40.704717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:40.713008 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.714060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.714502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.715637 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.716151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.716597 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.897024 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:40.897699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:40.906117 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.906774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.907525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.909147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.909941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.910439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.963587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:40.974214 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2f772167-8c26-4b62-9867-20c0b23e0073 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1699 microversion: 2.1 time: 0.274409 Aug 24 15:39:40.974834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 127/258] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:40 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1699 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:40.998095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-79e3fa93-dacd-49b8-9542-4170301d1a68 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:41.005275 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79e3fa93-dacd-49b8-9542-4170301d1a68 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.005467 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79e3fa93-dacd-49b8-9542-4170301d1a68 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.006275 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79e3fa93-dacd-49b8-9542-4170301d1a68 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.077961 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-79e3fa93-dacd-49b8-9542-4170301d1a68 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Going to try to start instance {{(pid=132288) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 15:39:41.127720 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-79e3fa93-dacd-49b8-9542-4170301d1a68 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action" status: 202 len: 0 microversion: 2.1 time: 0.133722 Aug 24 15:39:41.130707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 128/259] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:39:40 2022] POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:39:41.139142 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:41.139970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:41.147653 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.148330 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.148808 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.149650 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.150208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.150826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.151508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:41.164251 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1867cde5-cb39-419a-b9ec-87c7592bc00c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.272046 Aug 24 15:39:41.165610 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 132/260] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:40 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:41.194970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:41.195670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:41.203680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.204631 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.205414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.207013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.208019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.208661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.416984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:41.422090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:41.427865 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-60f4f178-17c4-4dee-86a3-aa7cc9267856 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1708 microversion: 2.1 time: 0.293772 Aug 24 15:39:41.437855 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 129/261] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:41 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1708 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:41.439526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a93ebdb8-f092-4962-9d1d-76ca58b778f3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.244789 Aug 24 15:39:41.439526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 133/262] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:41 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:41.447506 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-924c2f56-ba55-416c-967b-30691b08c93e req-8b815c20-b4bb-4b94-85d0-cad4b6839ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59", "tag": "e0707bad-7d33-40e8-946f-cca938471d41"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:41.462166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-924c2f56-ba55-416c-967b-30691b08c93e req-8b815c20-b4bb-4b94-85d0-cad4b6839ebf service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.462856 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-924c2f56-ba55-416c-967b-30691b08c93e req-8b815c20-b4bb-4b94-85d0-cad4b6839ebf service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.463191 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-924c2f56-ba55-416c-967b-30691b08c93e req-8b815c20-b4bb-4b94-85d0-cad4b6839ebf service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.513711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-924c2f56-ba55-416c-967b-30691b08c93e req-8b815c20-b4bb-4b94-85d0-cad4b6839ebf service nova] Creating event network-changed:e0707bad-7d33-40e8-946f-cca938471d41 for instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 on hv-cinder-84605 Aug 24 15:39:41.526173 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-924c2f56-ba55-416c-967b-30691b08c93e req-8b815c20-b4bb-4b94-85d0-cad4b6839ebf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095710 Aug 24 15:39:41.527997 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 130/263] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:41.664236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:41.666167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:41.675883 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.676892 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.677425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.678228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.678799 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.679451 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.025381 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:42.038073 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7954ff39-1735-4a17-82f9-f2f63e12b32b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.380620 Aug 24 15:39:42.039101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 134/264] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:41 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:42.193060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:42.194818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:42.207002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.207516 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.219494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.221282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.222060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.223597 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.456470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:42.457129 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:42.460885 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:42.468801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.469311 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.469740 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.470499 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.471043 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.471463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.480928 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1098aeac-c920-4d5e-8a22-3c378c227ae1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.296568 Aug 24 15:39:42.482807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 131/265] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:42 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:42.492454 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:42.493304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:42.501570 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.503044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.503887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.505100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.505908 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.506786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.742070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:42.747335 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:42.750101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d27adfd1-0429-477b-8692-dac12969eca4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.265044 Aug 24 15:39:42.750967 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 132/266] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:42 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:42.761614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-12379d7b-7056-4b66-bf28-9e82f34aee46 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1708 microversion: 2.1 time: 0.309836 Aug 24 15:39:42.762583 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 135/267] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:42 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1708 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:42.977597 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-722807a3-072d-4cce-80f2-8af828bceadf req-80be7256-bb48-4996-836c-6b2784ed1fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd8a365-ce5e-405e-8b76-93303538f94e", "name": "network-vif-plugged", "status": "completed", "tag": "d30bf2eb-be05-4025-9994-339e033189d7"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:42.991186 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-722807a3-072d-4cce-80f2-8af828bceadf req-80be7256-bb48-4996-836c-6b2784ed1fd3 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.991980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-722807a3-072d-4cce-80f2-8af828bceadf req-80be7256-bb48-4996-836c-6b2784ed1fd3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.992486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-722807a3-072d-4cce-80f2-8af828bceadf req-80be7256-bb48-4996-836c-6b2784ed1fd3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.006954 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-722807a3-072d-4cce-80f2-8af828bceadf req-80be7256-bb48-4996-836c-6b2784ed1fd3 service nova] Creating event network-vif-plugged:d30bf2eb-be05-4025-9994-339e033189d7 for instance 8dd8a365-ce5e-405e-8b76-93303538f94e on hv-cinder-84605 Aug 24 15:39:43.012454 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-722807a3-072d-4cce-80f2-8af828bceadf req-80be7256-bb48-4996-836c-6b2784ed1fd3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039633 Aug 24 15:39:43.013618 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 133/268] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:43.061928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:43.062793 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:43.064682 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=8 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:43.070547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.071069 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.071505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.072272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.072704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.073191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.230025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:43.239093 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2ce9180b-fa5a-4fc8-9130-f191b71325f2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.181053 Aug 24 15:39:43.239626 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 136/269] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:43 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:43.504711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:43.505400 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:43.511563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.512041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.512475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.513152 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.513599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.514018 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.646212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:43.655247 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-52c295b4-bb8a-44f4-a24c-990a94c85e58 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.155156 Aug 24 15:39:43.655994 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 134/270] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:43 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:43.773997 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:43.774678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:43.782443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.783086 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.784479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.785048 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:43.785457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.785669 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:43.786152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.786827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.791668 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.792159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.792599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:43.793305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:43.793782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:43.794180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:44.001499 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:44.007889 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:44.009902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-38103dde-0481-4551-973e-012fa82c40df tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.239661 Aug 24 15:39:44.010661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 137/271] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:43 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:44.016825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b7ab7fa2-0fb3-47f3-9a8b-611c74bed146 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1708 microversion: 2.1 time: 0.236273 Aug 24 15:39:44.018284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 135/272] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:43 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1708 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:44.260328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:44.261060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:44.270154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:44.271263 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:44.272015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:44.273227 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:44.274012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:44.274783 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:44.475412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:44.486508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d8870dab-7662-4989-bf85-198b1db406c1 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.230027 Aug 24 15:39:44.487257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 138/273] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:44 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:44.680783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:44.681583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:44.684329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:44.685684 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=24 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:44.693894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:44.694408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:44.695006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:44.695790 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:44.696420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:44.696944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:44.870840 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:44.882614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-eb25f577-c30a-4273-9aee-ad6dd8e76283 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.205845 Aug 24 15:39:44.883534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 136/274] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:44 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:45.039778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:45.040397 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:45.041548 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:45.042167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:45.048322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.049437 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.050014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.050981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.051666 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.052653 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.052892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.053420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.053916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.058333 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.059079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=100 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:45.059369 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.060098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.313200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:45.325243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1e2d6a64-e4f6-4617-b630-641ce20dc4d4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.295039 Aug 24 15:39:45.326284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 139/275] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:45 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:45.411047 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:45.421136 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a3c32db7-d4bc-475f-bee5-f38c187a645c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1712 microversion: 2.1 time: 0.384379 Aug 24 15:39:45.421783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 137/276] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:45 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1712 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:45.514003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:45.514697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:45.527519 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.528205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.528953 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.530079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.530999 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.531922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.685454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:45.694728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-63acb5a4-9e23-447c-881d-cec3ef3bd3b9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.186473 Aug 24 15:39:45.695331 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 140/277] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:45 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:45.906564 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:45.907863 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:45.915426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.915939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.916457 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.917290 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.917964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.918469 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:46.183885 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:46.193165 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5a84f093-4ad5-4421-b9eb-4db2e7ff69bb tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1370 microversion: 2.1 time: 0.291921 Aug 24 15:39:46.193915 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 138/278] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:45 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:46.356319 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:46.356919 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:46.365205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:46.365695 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:46.366132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:46.367014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:46.367557 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:46.368059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:46.717409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:46.719284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:46.720151 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:46.722273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:46.730193 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:46.731246 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-be9799cd-b769-4b33-85e1-cb0a3d4d2341 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.379758 Aug 24 15:39:46.731733 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:46.732365 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:46.733109 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:46.733565 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:46.734211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:46.743280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 141/279] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:46 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:46.962334 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:46.974339 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a404cd1e-9fd8-42e6-8d46-ef532daca597 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.261930 Aug 24 15:39:46.990515 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 139/280] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:46 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:47.216688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:47.217559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:47.226979 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.227782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.228448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.229733 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.230727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.231518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.426732 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:47.449080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3a368031-1889-40d8-92da-796d4dfc37a7 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1563 microversion: 2.1 time: 0.237623 Aug 24 15:39:47.452075 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 142/281] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:47 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1563 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:47.467128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-02754d8e-d4cc-4545-bcbb-7d08b25de0b8 req-9e6c75bd-e1de-47c0-a9c2-4d9c13982037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f35f56-4bfe-416c-861e-c49c02f623c2", "name": "network-vif-plugged", "status": "completed", "tag": "5a903b96-7262-4382-b289-851e17d994de"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:47.477280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:47.478189 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:47.486350 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.487340 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.488089 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.488891 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.489038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-02754d8e-d4cc-4545-bcbb-7d08b25de0b8 req-9e6c75bd-e1de-47c0-a9c2-4d9c13982037 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.489829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.490235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-02754d8e-d4cc-4545-bcbb-7d08b25de0b8 req-9e6c75bd-e1de-47c0-a9c2-4d9c13982037 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.490900 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.493787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-02754d8e-d4cc-4545-bcbb-7d08b25de0b8 req-9e6c75bd-e1de-47c0-a9c2-4d9c13982037 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.533040 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-02754d8e-d4cc-4545-bcbb-7d08b25de0b8 req-9e6c75bd-e1de-47c0-a9c2-4d9c13982037 service nova] Creating event network-vif-plugged:5a903b96-7262-4382-b289-851e17d994de for instance f7f35f56-4bfe-416c-861e-c49c02f623c2 on hv-cinder-84605 Aug 24 15:39:47.539341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-02754d8e-d4cc-4545-bcbb-7d08b25de0b8 req-9e6c75bd-e1de-47c0-a9c2-4d9c13982037 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087100 Aug 24 15:39:47.540874 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 140/282] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:47.623501 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-fbe3c32b-7c5e-47c7-936f-f21199193f7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151912 Aug 24 15:39:47.624752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 143/283] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:39:47 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:47.753469 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:47.754205 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:47.771040 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.771541 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.771986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.772714 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.773175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.773952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:48.010007 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:48.011592 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:48.025812 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:48.029001 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:48.030083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:48.033131 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:48.034082 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:48.035554 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:48.158786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:48.172393 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-490a50ea-e5a3-4f6a-8c11-8481b6391fc2 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.423658 Aug 24 15:39:48.173750 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 141/284] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:47 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:48.322923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:48.337917 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0a42083b-c5d1-47ff-b594-c1f84ecfb1c6 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.342272 Aug 24 15:39:48.340320 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 144/285] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:47 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:49.195569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:49.196294 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:49.202331 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-e912eac3-b9a1-4856-8833-71add0a5d81d req-bdad139e-157b-429a-837c-3112fbfae67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd8a365-ce5e-405e-8b76-93303538f94e", "tag": "d30bf2eb-be05-4025-9994-339e033189d7"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:49.220337 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:49.222978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:49.225682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:49.226707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:49.227542 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:49.229584 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-e912eac3-b9a1-4856-8833-71add0a5d81d req-bdad139e-157b-429a-837c-3112fbfae67d service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:49.229886 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-e912eac3-b9a1-4856-8833-71add0a5d81d req-bdad139e-157b-429a-837c-3112fbfae67d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:49.230313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-e912eac3-b9a1-4856-8833-71add0a5d81d req-bdad139e-157b-429a-837c-3112fbfae67d service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:49.231475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:49.274937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-e912eac3-b9a1-4856-8833-71add0a5d81d req-bdad139e-157b-429a-837c-3112fbfae67d service nova] Creating event network-changed:d30bf2eb-be05-4025-9994-339e033189d7 for instance 8dd8a365-ce5e-405e-8b76-93303538f94e on hv-cinder-84605 Aug 24 15:39:49.293043 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-e912eac3-b9a1-4856-8833-71add0a5d81d req-bdad139e-157b-429a-837c-3112fbfae67d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094693 Aug 24 15:39:49.299871 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 145/286] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:39:49.367607 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:49.368969 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:49.380051 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:49.381135 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:49.381863 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:49.383218 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:49.384026 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:49.386481 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:49.705260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:49.716786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a6f14f58-a7f8-4234-8822-6bf7112da99d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1366 microversion: 2.1 time: 0.523301 Aug 24 15:39:49.718918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 142/287] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:49 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:49.725071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-a2a5038b-ed19-4deb-9b81-d93efef3e164 req-1269bc50-c71e-4a93-8399-bd748d3e8bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59", "name": "network-vif-plugged", "status": "completed", "tag": "e0707bad-7d33-40e8-946f-cca938471d41"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:49.749577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a2a5038b-ed19-4deb-9b81-d93efef3e164 req-1269bc50-c71e-4a93-8399-bd748d3e8bd0 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:49.750286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a2a5038b-ed19-4deb-9b81-d93efef3e164 req-1269bc50-c71e-4a93-8399-bd748d3e8bd0 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:49.751046 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a2a5038b-ed19-4deb-9b81-d93efef3e164 req-1269bc50-c71e-4a93-8399-bd748d3e8bd0 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:49.756955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:49.772720 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-a2a5038b-ed19-4deb-9b81-d93efef3e164 req-1269bc50-c71e-4a93-8399-bd748d3e8bd0 service nova] Creating event network-vif-plugged:e0707bad-7d33-40e8-946f-cca938471d41 for instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 on hv-cinder-84605 Aug 24 15:39:49.780974 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-a2a5038b-ed19-4deb-9b81-d93efef3e164 req-1269bc50-c71e-4a93-8399-bd748d3e8bd0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060623 Aug 24 15:39:49.782217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 143/288] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:49.801854 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:49.811283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0caa9b7d-d39f-45bf-91cf-907d88ffafc9 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.453142 Aug 24 15:39:49.812754 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 146/289] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:49 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:50.745980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:50.746807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:50.762148 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:50.762740 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:50.763156 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:50.763828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:50.764285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:50.764714 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:50.833305 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:50.833913 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:50.836598 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:50.843664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:50.844162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:50.844596 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:50.845303 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:50.845800 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:50.846226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:51.169099 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:51.183939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8942b29c-6543-4966-8373-6a2d383b7c0e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1556 microversion: 2.1 time: 0.443271 Aug 24 15:39:51.184878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 144/290] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:50 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1556 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:51.205474 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:51.216739 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:51.217540 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:51.225939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-80f95974-ffec-4f33-ac1c-0814fa51ebe5 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1314 microversion: 2.1 time: 0.396583 Aug 24 15:39:51.232339 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:51.233387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:51.233986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:51.234415 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 147/291] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:50 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:51.237665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:51.238275 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:51.238892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:51.351924 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5bfbe7ae-7202-4245-b980-fe14e5b5f8b5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144898 Aug 24 15:39:51.353163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 145/292] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:39:51 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:52.247647 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:52.248270 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:52.262682 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:52.263322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:52.263759 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:52.264466 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:52.264931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:52.265352 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:52.921117 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:52.932477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bddd4ed2-32f6-471d-be57-32d34caf668c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1498 microversion: 2.1 time: 0.688629 Aug 24 15:39:52.947453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 148/293] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:52 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1498 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:53.446548 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-7badafce-cbbc-4f6b-bdf2-af1892a582e0 req-6007ff05-1fa4-47c1-913d-9e33388ec433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f35f56-4bfe-416c-861e-c49c02f623c2", "tag": "5a903b96-7262-4382-b289-851e17d994de"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:53.459309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7badafce-cbbc-4f6b-bdf2-af1892a582e0 req-6007ff05-1fa4-47c1-913d-9e33388ec433 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:53.459783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7badafce-cbbc-4f6b-bdf2-af1892a582e0 req-6007ff05-1fa4-47c1-913d-9e33388ec433 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:53.460211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7badafce-cbbc-4f6b-bdf2-af1892a582e0 req-6007ff05-1fa4-47c1-913d-9e33388ec433 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:53.474840 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-7badafce-cbbc-4f6b-bdf2-af1892a582e0 req-6007ff05-1fa4-47c1-913d-9e33388ec433 service nova] Creating event network-changed:5a903b96-7262-4382-b289-851e17d994de for instance f7f35f56-4bfe-416c-861e-c49c02f623c2 on hv-cinder-84605 Aug 24 15:39:53.483025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-7badafce-cbbc-4f6b-bdf2-af1892a582e0 req-6007ff05-1fa4-47c1-913d-9e33388ec433 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054117 Aug 24 15:39:53.487675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 146/294] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:39:53.549783 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:53.551025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:53.559610 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:53.560353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:53.561003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:53.562065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:53.562732 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:53.563313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:53.640688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:39:53.810529 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8f1a009e-d863-4875-99e0-960c04c18a76 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 204 len: 0 microversion: 2.1 time: 0.265992 Aug 24 15:39:53.812588 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 149/295] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:39:53 2022] DELETE /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:39:53.823573 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:53.824565 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:53.839636 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:53.840475 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:53.841104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:53.844306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:53.845057 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:53.847411 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:54.066557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:54.076097 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d52ac85f-290f-43f5-af08-41ec83a25d7c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1504 microversion: 2.1 time: 0.258671 Aug 24 15:39:54.077311 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 147/296] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:53 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:54.615263 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-623883853", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:54.695652 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] validate_networks() for None {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:39:55.098269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:55.099703 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:55.107715 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:55.108207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:55.108673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:55.109666 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:55.110123 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:55.110547 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:55.328088 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:39:55.328903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:39:55.329596 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:39:55.330833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:39:55.332200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:39:55.342201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:55.343106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:55.343749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:55.344702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:55.345655 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:55.346491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:55.367013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Getting quotas for project 9128d708b9c645cf914914a2378ff6ed. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:39:55.371730 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Getting quotas for user d2f10d8db93a411d92b1e92fbd33a141 and project 9128d708b9c645cf914914a2378ff6ed. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:39:55.384926 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:39:55.389367 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:39:55.438606 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:55.452614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e24422c4-f29e-417f-b6bf-98df0e18cf0f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842793 Aug 24 15:39:55.463004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 150/297] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:39:55.465637 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cce977aa-cfe1-4bc0-9c37-24f3a7fc4c42 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1504 microversion: 2.1 time: 0.371866 Aug 24 15:39:55.466219 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 148/298] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:55 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:55.468083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-12d335b0-5e02-4b91-ada7-9a787b4fc906 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:55.468703 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-12d335b0-5e02-4b91-ada7-9a787b4fc906 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:55.582619 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-12d335b0-5e02-4b91-ada7-9a787b4fc906 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:55.592040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-12d335b0-5e02-4b91-ada7-9a787b4fc906 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1214 microversion: 2.1 time: 0.127675 Aug 24 15:39:55.594515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 151/299] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:55 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:56.403796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-039f8569-8bc0-44ef-80b1-bc16de3b4258 req-d9db1da5-021c-49c4-bdc8-6d938a1bd344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59", "name": "network-vif-deleted", "tag": "e0707bad-7d33-40e8-946f-cca938471d41"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:56.435649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-039f8569-8bc0-44ef-80b1-bc16de3b4258 req-d9db1da5-021c-49c4-bdc8-6d938a1bd344 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:56.436222 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-039f8569-8bc0-44ef-80b1-bc16de3b4258 req-d9db1da5-021c-49c4-bdc8-6d938a1bd344 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:56.437309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-039f8569-8bc0-44ef-80b1-bc16de3b4258 req-d9db1da5-021c-49c4-bdc8-6d938a1bd344 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:56.453814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-039f8569-8bc0-44ef-80b1-bc16de3b4258 req-d9db1da5-021c-49c4-bdc8-6d938a1bd344 service nova] Creating event network-vif-deleted:e0707bad-7d33-40e8-946f-cca938471d41 for instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 on hv-cinder-84605 Aug 24 15:39:56.462242 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-039f8569-8bc0-44ef-80b1-bc16de3b4258 req-d9db1da5-021c-49c4-bdc8-6d938a1bd344 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063453 Aug 24 15:39:56.463482 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 149/300] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:39:56.491083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:56.491706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:56.504812 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:56.511479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:56.512210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:56.513146 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:56.513798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:56.514420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:56.622167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:56.623224 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:56.639577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:56.641654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:56.643358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:56.651480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:56.652617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:56.653323 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:56.655379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:56.663857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1369764a-e016-42b4-b5ab-27bde7126d99 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 200 len: 1299 microversion: 2.1 time: 0.179353 Aug 24 15:39:56.664445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 152/301] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:56 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:56.748828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:56.759197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-28d9ede1-918c-4cd4-9379-6d9101bf321a tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1266 microversion: 2.1 time: 0.145255 Aug 24 15:39:56.771797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 150/302] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:56 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:57.685305 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:57.686191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:57.696447 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:57.697322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:57.698320 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:57.699548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:57.700245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:57.700855 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:57.726595 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] HTTP exception thrown: Instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 could not be found. Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Request method failure captured: Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 HTTP/1.1 Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkYzlxtrstFo8vp6XN4MxR_LNQSLs9-9y6QgHxe2-63BJFrp1vTgsKUvRZy4eRqBkZY_DLrhpDoM4AeKqrHikcTv4II71zywXi7ROhDQA7c4oz49uj5x9oO-MDBw8_oo4d4jfCU4bLQ2DzYk9vaY4QTfms8_g3OurBA1Fh1swAsO8dI Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: df1ee75d012f4378a607020154eaf0b4 Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesActionsTest-655072483 Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:39:57.728861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_df1ee75d012f4378a607020154eaf0b4", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df1ee75d012f4378a607020154eaf0b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df1ee75d012f4378a607020154eaf0b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/df1ee75d012f4378a607020154eaf0b4"}]}] Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesActionsTest-655072483 Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: df1ee75d012f4378a607020154eaf0b4 Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesActionsTest-655072483 Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesActionsTest-655072483-project Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: ff886c5f2516476e85e9e805aa19fece Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesActionsTest-655072483-project Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 could not be found. Aug 24 15:39:57.730156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59'} Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 could not be found. Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:39:57.731175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 could not be found. Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 could not be found. Aug 24 15:39:57.732351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:39:57.735645 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Returning 404 to user: Instance 7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:39:57.736919 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bdb5bcca-26e9-4ffd-b10c-de65fcbd341b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59" status: 404 len: 111 microversion: 2.1 time: 0.055535 Aug 24 15:39:57.737986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 153/303] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:57 2022] GET /compute/v2.1/servers/7bb36acf-6a2f-4b76-9c5e-c5f6bbd0fd59 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:39:57.793045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:57.793656 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:57.806127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:57.808253 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:57.809976 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:57.810997 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:57.811876 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:57.815318 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:57.916570 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-82517954", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "networks": [{"uuid": "cc385d41-488b-42c2-8d03-cfd468490140"}]}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:57.921821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:57.930101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0eb83a0e-aafd-469d-976c-b991c33e046b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1272 microversion: 2.1 time: 0.140944 Aug 24 15:39:57.945140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 151/304] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:57 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:58.014532 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] validate_networks() for [('cc385d41-488b-42c2-8d03-cfd468490140', None, None, None, None, None)] {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:39:58.459972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:39:58.460848 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:39:58.461659 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:39:58.462333 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:39:58.463019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:39:58.477215 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.478440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.479565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.480851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.481556 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.482286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.510351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Getting quotas for project df1ee75d012f4378a607020154eaf0b4. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:39:58.517414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Getting quotas for user ff886c5f2516476e85e9e805aa19fece and project df1ee75d012f4378a607020154eaf0b4. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:39:58.538656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:39:58.542200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:39:58.610060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f9110ac3-ca41-42ed-a56c-9232b5260d87 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698728 Aug 24 15:39:58.618548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 154/305] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:39:58.623845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2a4d1fa0-b3cb-405d-b500-ae9974adeef3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:58.624744 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2a4d1fa0-b3cb-405d-b500-ae9974adeef3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:58.748529 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2a4d1fa0-b3cb-405d-b500-ae9974adeef3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:58.757328 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2a4d1fa0-b3cb-405d-b500-ae9974adeef3 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1212 microversion: 2.1 time: 0.138689 Aug 24 15:39:58.758255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 152/306] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:58 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1212 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:58.952074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:58.952694 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:58.962143 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.962694 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.963195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.964466 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.964828 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.965269 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:59.164693 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:59.179588 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-fdad9d36-90ba-4e5c-a240-46094862414b tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.231752 Aug 24 15:39:59.180386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 155/307] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:58 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:59.783158 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:59.784928 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:59.792087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:59.792667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:59.793167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:59.794060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:59.794723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:59.795694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:59.900314 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:59.909312 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9d6534f3-fc2d-4b00-9b38-b80d54254f79 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1264 microversion: 2.1 time: 0.134323 Aug 24 15:39:59.910015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 153/308] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:59 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:00.201619 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:00.203200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:00.210619 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:00.211521 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:00.212165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:00.213168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:00.213883 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:00.214514 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:00.375766 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:00.385216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-03d8fc68-250e-4cdf-a3c7-e43c9a05ddd9 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.188008 Aug 24 15:40:00.385784 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 156/309] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:00 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:00.931341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:00.931957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:00.938529 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:00.939264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:00.940311 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:00.941066 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:00.941543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:00.941957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:01.006803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:01.015059 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-22198662-38bb-447c-a7fb-19aea38ef402 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1270 microversion: 2.1 time: 0.087208 Aug 24 15:40:01.015626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 154/310] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:00 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:01.120300 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-967e469b-1cb6-4b79-95ba-9ae8923ff8cb req-338b5b82-0b97-47a9-b061-6f1510cd55f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5284e905-c524-43ed-9d96-20e078df2a50", "tag": "8ee4b72d-06e6-445c-b67f-76ba6a440e1a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:01.133987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-967e469b-1cb6-4b79-95ba-9ae8923ff8cb req-338b5b82-0b97-47a9-b061-6f1510cd55f7 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:01.134686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-967e469b-1cb6-4b79-95ba-9ae8923ff8cb req-338b5b82-0b97-47a9-b061-6f1510cd55f7 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:01.135190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-967e469b-1cb6-4b79-95ba-9ae8923ff8cb req-338b5b82-0b97-47a9-b061-6f1510cd55f7 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:01.146893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-967e469b-1cb6-4b79-95ba-9ae8923ff8cb req-338b5b82-0b97-47a9-b061-6f1510cd55f7 service nova] Creating event network-changed:8ee4b72d-06e6-445c-b67f-76ba6a440e1a for instance 5284e905-c524-43ed-9d96-20e078df2a50 on hv-cinder-84605 Aug 24 15:40:01.151809 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-967e469b-1cb6-4b79-95ba-9ae8923ff8cb req-338b5b82-0b97-47a9-b061-6f1510cd55f7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037628 Aug 24 15:40:01.152394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 157/311] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:01.405786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:01.406493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:01.413319 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:01.414565 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:01.415555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:01.416687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:01.417687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:01.418575 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:01.591172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:01.605818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-10545da5-b95c-488f-8e7d-1253a3a06ada tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.204329 Aug 24 15:40:01.606843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 155/312] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:01 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:02.040212 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:02.041079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:02.047653 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:02.048621 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:02.049882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:02.050756 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:02.051293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:02.051795 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:02.220683 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:02.225778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:02.232527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-55711f9a-54e7-4472-99a7-0a39cde6623f tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.198231 Aug 24 15:40:02.233205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 158/313] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:02 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:02.629085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:02.630174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:02.641262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:02.642110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:02.643319 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:02.645501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:02.646112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:02.646726 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:02.865722 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:02.875889 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3d8a71e5-42e9-4e77-813d-e074b378457f tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.250886 Aug 24 15:40:02.877606 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 156/314] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:02 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:03.259934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:03.261216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:03.276685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:03.279327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:03.280630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:03.281523 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:03.286875 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-9b62340a-8b23-4a91-96f4-71645bf7bcc7 req-a1be9b08-483d-4db8-b5b5-ddc2b5684874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a66e7e7-cc2a-4da5-bf7c-320857fcd190", "tag": "757c5148-626f-497b-9c3f-eb7ddc451517"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:03.294995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:03.297148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:03.311026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9b62340a-8b23-4a91-96f4-71645bf7bcc7 req-a1be9b08-483d-4db8-b5b5-ddc2b5684874 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:03.311809 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9b62340a-8b23-4a91-96f4-71645bf7bcc7 req-a1be9b08-483d-4db8-b5b5-ddc2b5684874 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:03.328178 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9b62340a-8b23-4a91-96f4-71645bf7bcc7 req-a1be9b08-483d-4db8-b5b5-ddc2b5684874 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:03.363834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-9b62340a-8b23-4a91-96f4-71645bf7bcc7 req-a1be9b08-483d-4db8-b5b5-ddc2b5684874 service nova] Creating event network-changed:757c5148-626f-497b-9c3f-eb7ddc451517 for instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 on hv-cinder-84605 Aug 24 15:40:03.376481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-9b62340a-8b23-4a91-96f4-71645bf7bcc7 req-a1be9b08-483d-4db8-b5b5-ddc2b5684874 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091967 Aug 24 15:40:03.378082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 157/315] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:03.556565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:03.570546 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e8803891-ef6e-4d3a-bbcb-e96e1eb213ec tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.316001 Aug 24 15:40:03.586019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 159/316] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:03 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:03.903203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:03.904105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:03.916793 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:03.919724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:03.920298 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:03.921153 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:03.922668 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:03.923234 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:04.197721 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:04.211601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4a9cd582-f7f9-45c9-8a2b-772f51c047ce tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.313256 Aug 24 15:40:04.224438 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 158/317] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:03 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:04.594870 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:04.596388 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:04.605626 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:04.607009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:04.607660 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:04.609019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:04.609635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:04.610272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:04.815772 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:04.835714 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e3882e7e-cc7d-4d89-a51f-476b0ea9c70e tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.246234 Aug 24 15:40:04.850679 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 160/318] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:04 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:05.261748 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:05.264412 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:05.279913 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:05.280418 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:05.280862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:05.283360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:05.286890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:05.287539 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:05.509808 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:05.520198 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-24811cef-fc7a-45e6-93ec-b4c80c99a4cd tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.264457 Aug 24 15:40:05.521279 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 159/319] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:05 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:05.871340 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:05.872874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:05.882089 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:05.882988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:05.884006 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:05.884969 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:05.885617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:05.886230 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:06.065628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:06.081113 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-09fe9193-b088-45c4-9d50-2b8fa5e36b68 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.213093 Aug 24 15:40:06.082097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 161/320] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:05 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:06.542599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:06.543494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:06.550276 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:06.551069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:06.551890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:06.552620 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:06.553084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:06.553530 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:06.726374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:06.734592 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5685c990-2fee-4a9d-a980-e7c1511a8b89 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.197103 Aug 24 15:40:06.735476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 160/321] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:06 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:07.107197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:07.108463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:07.123345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:07.124129 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:07.124764 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:07.125700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:07.126340 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:07.128275 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:07.335195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:07.335521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-71132066-9538-4d93-a403-fd3fbb2ea0d9 req-34e854ed-6e6b-4fc8-88f1-e1dbbe875fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5284e905-c524-43ed-9d96-20e078df2a50", "name": "network-vif-plugged", "status": "completed", "tag": "8ee4b72d-06e6-445c-b67f-76ba6a440e1a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:07.344552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bdee14ae-aaf7-438d-9caa-08c896ca6848 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.241308 Aug 24 15:40:07.365338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 162/322] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:07 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:07.367176 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-71132066-9538-4d93-a403-fd3fbb2ea0d9 req-34e854ed-6e6b-4fc8-88f1-e1dbbe875fd7 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:07.368423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-71132066-9538-4d93-a403-fd3fbb2ea0d9 req-34e854ed-6e6b-4fc8-88f1-e1dbbe875fd7 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:07.368801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-71132066-9538-4d93-a403-fd3fbb2ea0d9 req-34e854ed-6e6b-4fc8-88f1-e1dbbe875fd7 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:07.388986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-71132066-9538-4d93-a403-fd3fbb2ea0d9 req-34e854ed-6e6b-4fc8-88f1-e1dbbe875fd7 service nova] Creating event network-vif-plugged:8ee4b72d-06e6-445c-b67f-76ba6a440e1a for instance 5284e905-c524-43ed-9d96-20e078df2a50 on hv-cinder-84605 Aug 24 15:40:07.407742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-71132066-9538-4d93-a403-fd3fbb2ea0d9 req-34e854ed-6e6b-4fc8-88f1-e1dbbe875fd7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080570 Aug 24 15:40:07.409424 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 161/323] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:07.757217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:07.757967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:07.764189 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:07.764777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:07.765236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:07.765995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:07.766449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:07.766902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:07.917942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:07.928968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-606396ab-4759-4c89-aecb-ceb1b19e8a3c tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.174711 Aug 24 15:40:07.928968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 163/324] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:07 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:08.373956 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:08.374803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:08.382293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:08.382829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:08.383271 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:08.383987 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:08.384451 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:08.384907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:08.555492 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:08.564133 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e3618851-7651-4865-b86d-1bb7648d90b7 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.194938 Aug 24 15:40:08.565474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 162/325] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:08 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:08.949910 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:08.950537 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:08.952891 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=4 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:08.953546 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=14 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:08.960176 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:08.960669 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:08.961105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:08.961988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:08.962440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:08.962891 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:09.187061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:09.197660 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0f733752-56b1-4716-bf4f-53702beb46c8 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1314 microversion: 2.1 time: 0.252805 Aug 24 15:40:09.199175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 164/326] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:08 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:09.431361 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:09.437055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-293d5d51-c589-4aee-80fa-d0076207daea req-92fa5d84-3bcd-4a82-8440-22e7dddb1257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a66e7e7-cc2a-4da5-bf7c-320857fcd190", "name": "network-vif-plugged", "status": "completed", "tag": "757c5148-626f-497b-9c3f-eb7ddc451517"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:09.456616 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-293d5d51-c589-4aee-80fa-d0076207daea req-92fa5d84-3bcd-4a82-8440-22e7dddb1257 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:09.457110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-293d5d51-c589-4aee-80fa-d0076207daea req-92fa5d84-3bcd-4a82-8440-22e7dddb1257 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:09.457550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-293d5d51-c589-4aee-80fa-d0076207daea req-92fa5d84-3bcd-4a82-8440-22e7dddb1257 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:09.470315 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-293d5d51-c589-4aee-80fa-d0076207daea req-92fa5d84-3bcd-4a82-8440-22e7dddb1257 service nova] Creating event network-vif-plugged:757c5148-626f-497b-9c3f-eb7ddc451517 for instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 on hv-cinder-84605 Aug 24 15:40:09.478248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-293d5d51-c589-4aee-80fa-d0076207daea req-92fa5d84-3bcd-4a82-8440-22e7dddb1257 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047562 Aug 24 15:40:09.478953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 163/327] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:09.587154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:09.587763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:09.598063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:09.599120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:09.599737 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:09.600628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:09.601253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:09.601679 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:10.009755 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:10.019288 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-934d836c-ed9b-48b0-81be-9524ffeca479 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.435819 Aug 24 15:40:10.019792 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 165/328] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:09 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:10.222799 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:10.223780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:10.231627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:10.232306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:10.232916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:10.233625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:10.234095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:10.234495 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:10.382140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:10.390232 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9581a83d-b4f7-49c0-a005-845d52002572 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1464 microversion: 2.1 time: 0.174700 Aug 24 15:40:10.391468 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 164/329] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:10 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:10.437500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:10.437986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:10.444502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:10.444987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:10.445467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:10.446163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:10.447986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:10.447986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:10.477553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:40:10.575204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1074d5ba-1824-4fa3-8b66-d142682e6811 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 204 len: 0 microversion: 2.1 time: 0.140505 Aug 24 15:40:10.577022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 166/330] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:40:10 2022] DELETE /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:40:10.587170 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:10.588397 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:10.596466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:10.597037 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:10.597537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:10.598297 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:10.599114 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:10.599641 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:10.605196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=100 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:10.761642 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:10.770509 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a68f601e-fd6b-4b41-a2ce-b96135646684 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1470 microversion: 2.1 time: 0.189332 Aug 24 15:40:10.771441 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 165/331] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:10 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:11.040379 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:11.041083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:11.047163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:11.047903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:11.048597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:11.050066 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:11.050827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:11.051477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:11.194359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:11.202794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-35b5951a-4d86-40b1-84d6-67a6fdfba98c tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1312 microversion: 2.1 time: 0.166456 Aug 24 15:40:11.203726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 167/332] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:11 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:11.790825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:11.791572 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:11.798364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:11.799490 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:11.800554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:11.801551 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:11.802208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:11.802823 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:11.944281 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:11.952133 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-23687f85-4d5e-4aad-b6a7-80d5d1dae211 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1470 microversion: 2.1 time: 0.165295 Aug 24 15:40:11.952705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 166/333] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:11 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:12.027606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f2b7e197-0ffb-4340-b7d4-119fdfc1b365 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Action: 'create', calling method: .version_select at 0x7f07907cd670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-955769496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByBAeqHgCCWXCtcDYF8B7pl+xisdMhFxp5XOo92/4EoHcY+dYe0FCR1vfXnvSIcQykGsRPoLH02Dc7pF1fv8kt+PgotJFJCnTuISIWfyL57GIBo+5sVCexTz2MZ5xGAfg=="}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:12.043380 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-f2b7e197-0ffb-4340-b7d4-119fdfc1b365 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Getting quotas for project 0159b61c064b4eca9fcb9ed3c1fff2b5. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:40:12.048388 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-f2b7e197-0ffb-4340-b7d4-119fdfc1b365 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Getting quotas for user 0c0cd616a3794428809f28dfbc86e7b9 and project 0159b61c064b4eca9fcb9ed3c1fff2b5. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:40:12.070061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f2b7e197-0ffb-4340-b7d4-119fdfc1b365 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046468 Aug 24 15:40:12.070721 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 168/334] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:40:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:12.120737 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-252873426", "imageRef": "e3307ec1-f791-4d81-b48a-58bfb2897ea0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-955769496", "networks": [{"uuid": "e491238d-18b9-4e6b-89f5-934f642bbaa2"}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:12.174946 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] validate_networks() for [('e491238d-18b9-4e6b-89f5-934f642bbaa2', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:40:12.224653 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:12.225923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:12.233052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.233539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.233976 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:12.234697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.235154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.235639 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:12.429691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:12.437482 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4bac6c52-1799-447a-a824-70b7c4656c74 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1496 microversion: 2.1 time: 0.217632 Aug 24 15:40:12.438057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 169/335] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:12 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1496 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:12.619607 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:40:12.620033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:40:12.620517 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:40:12.620980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:40:12.622137 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:40:12.632228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.632717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.633153 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:12.633880 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.634336 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.634802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:12.653118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Getting quotas for project 0159b61c064b4eca9fcb9ed3c1fff2b5. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:40:12.657083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Getting quotas for user 0c0cd616a3794428809f28dfbc86e7b9 and project 0159b61c064b4eca9fcb9ed3c1fff2b5. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:40:12.668163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:40:12.670396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e3307ec1-f791-4d81-b48a-58bfb2897ea0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:40:12.720136 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-416332fd-6a4d-449c-840b-5b576c9400ce tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603132 Aug 24 15:40:12.721143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 167/336] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:40:12.732181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-255eb8ef-4c7b-4128-8fc3-513c25e62a91 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:12.732636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-255eb8ef-4c7b-4128-8fc3-513c25e62a91 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:12.750877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:12.803604 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-255eb8ef-4c7b-4128-8fc3-513c25e62a91 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:12.810685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-255eb8ef-4c7b-4128-8fc3-513c25e62a91 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1257 microversion: 2.1 time: 0.082654 Aug 24 15:40:12.811206 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 170/337] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:12 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1257 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:12.975098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:12.975713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:12.979505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:12.980028 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:12.985914 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.986401 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.987204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:12.987912 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.988093 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.988364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.988597 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.989033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:12.989182 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:12.989752 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:12.990208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:12.990656 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:13.028854 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:40:13.120178 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-abf4e0f0-9dd0-42ce-8f0f-ba9484324ae2 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 204 len: 0 microversion: 2.1 time: 0.144218 Aug 24 15:40:13.121960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 171/338] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:40:12 2022] DELETE /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:40:13.131242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:13.132115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:13.140122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:13.141337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:13.141846 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:13.142622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:13.144092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:13.145636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:13.181213 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:13.188990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f8176fc9-386f-41c2-b596-a4f09bb865ca tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1470 microversion: 2.1 time: 0.219382 Aug 24 15:40:13.190394 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 168/339] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:12 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:13.302308 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:13.309894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1efc2bcd-3d19-4a76-83c8-6d728fa22f32 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1502 microversion: 2.1 time: 0.183814 Aug 24 15:40:13.310458 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 172/340] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:13 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:13.468458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-ab1cc4a2-3fce-4f28-ae1a-d6acf8a7cca7 req-cd105dc0-7a6a-4108-b382-4f290bd577d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5284e905-c524-43ed-9d96-20e078df2a50", "name": "network-vif-deleted", "tag": "8ee4b72d-06e6-445c-b67f-76ba6a440e1a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:13.479470 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-ab1cc4a2-3fce-4f28-ae1a-d6acf8a7cca7 req-cd105dc0-7a6a-4108-b382-4f290bd577d8 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:13.479945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-ab1cc4a2-3fce-4f28-ae1a-d6acf8a7cca7 req-cd105dc0-7a6a-4108-b382-4f290bd577d8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:13.480370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-ab1cc4a2-3fce-4f28-ae1a-d6acf8a7cca7 req-cd105dc0-7a6a-4108-b382-4f290bd577d8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:13.491775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-ab1cc4a2-3fce-4f28-ae1a-d6acf8a7cca7 req-cd105dc0-7a6a-4108-b382-4f290bd577d8 service nova] Creating event network-vif-deleted:8ee4b72d-06e6-445c-b67f-76ba6a440e1a for instance 5284e905-c524-43ed-9d96-20e078df2a50 on hv-cinder-84605 Aug 24 15:40:13.496617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-ab1cc4a2-3fce-4f28-ae1a-d6acf8a7cca7 req-cd105dc0-7a6a-4108-b382-4f290bd577d8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Aug 24 15:40:13.497212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 169/341] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:40:13.832731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:13.833363 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:13.839595 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:13.840073 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:13.840502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:13.841190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:13.841636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:13.842056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:13.902302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:13.910344 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-da15108d-5c52-42f1-8cd8-a5d7c3e018bf tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1261 microversion: 2.1 time: 0.081906 Aug 24 15:40:13.911018 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 173/342] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:13 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:14.211635 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:14.212245 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:14.218458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:14.218964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:14.219396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:14.220083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:14.220535 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:14.221483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:14.286606 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:14.294344 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7a8940d0-c1a0-4814-b307-94ef6cb75c04 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1428 microversion: 2.1 time: 0.087561 Aug 24 15:40:14.294946 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 170/343] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:14 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:14.331022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:14.331636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:14.337990 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:14.338466 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:14.339104 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:14.339833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:14.340283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:14.340703 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:14.344861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:14.493431 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:14.502960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-97e88eb3-d2ff-4716-9cc1-48eb15ba7f94 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1502 microversion: 2.1 time: 0.175133 Aug 24 15:40:14.503748 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 174/344] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:14 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:14.940883 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:14.941489 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:14.947573 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:14.948238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:14.948811 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:14.949518 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:14.949976 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:14.950399 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:15.013771 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:15.022925 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-96e4c651-5038-4615-b7fd-4833fa74e9e1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1309 microversion: 2.1 time: 0.095444 Aug 24 15:40:15.023778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 171/345] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:14 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:15.316618 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:15.317654 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:15.324390 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:15.325302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:15.326885 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:15.328350 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:15.329205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:15.330014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:15.376842 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:15.378091 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:15.378664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:15.379495 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lazy-loading 'fault' on Instance uuid 5284e905-c524-43ed-9d96-20e078df2a50 {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:40:15.439269 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f10d8db93a411d92b1e92fbd33a141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9128d708b9c645cf914914a2378ff6ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:15.448817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-dd355087-5819-4e3d-994c-5814b5d425bb tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 200 len: 1304 microversion: 2.1 time: 0.137117 Aug 24 15:40:15.462865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 175/346] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:15 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:15.527136 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:15.529256 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:15.538031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:15.538546 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:15.539189 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:15.539900 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:15.540357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:15.540781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:15.682325 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:15.690302 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cd8be357-226a-4eea-ae17-81942e877a95 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1502 microversion: 2.1 time: 0.168823 Aug 24 15:40:15.690912 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 172/347] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:15 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:16.044593 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:16.045550 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:16.062623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:16.063184 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:16.063749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:16.064518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:16.065159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:16.065881 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:16.093500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-1ea0b9ee-9222-4df1-a016-ec77f8224dbf req-06a65914-6793-4ba2-ad1c-2b8ef71a3798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a66e7e7-cc2a-4da5-bf7c-320857fcd190", "name": "network-vif-deleted", "tag": "757c5148-626f-497b-9c3f-eb7ddc451517"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:16.105639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-1ea0b9ee-9222-4df1-a016-ec77f8224dbf req-06a65914-6793-4ba2-ad1c-2b8ef71a3798 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:16.106626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-1ea0b9ee-9222-4df1-a016-ec77f8224dbf req-06a65914-6793-4ba2-ad1c-2b8ef71a3798 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:16.107667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-1ea0b9ee-9222-4df1-a016-ec77f8224dbf req-06a65914-6793-4ba2-ad1c-2b8ef71a3798 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:16.122981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-1ea0b9ee-9222-4df1-a016-ec77f8224dbf req-06a65914-6793-4ba2-ad1c-2b8ef71a3798 service nova] Creating event network-vif-deleted:757c5148-626f-497b-9c3f-eb7ddc451517 for instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 on hv-cinder-84605 Aug 24 15:40:16.129358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-1ea0b9ee-9222-4df1-a016-ec77f8224dbf req-06a65914-6793-4ba2-ad1c-2b8ef71a3798 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040132 Aug 24 15:40:16.142505 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 173/348] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:16.195744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:16.213694 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-29f34be2-9147-42ac-be37-eeb37761bc2a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.173095 Aug 24 15:40:16.214673 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 176/349] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:16 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:16.473701 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:16.474836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] [instance: 5284e905-c524-43ed-9d96-20e078df2a50] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:16.481692 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:16.482695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:16.483331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:16.484272 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:16.484940 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:16.485563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:16.504392 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] HTTP exception thrown: Instance 5284e905-c524-43ed-9d96-20e078df2a50 could not be found. Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Request method failure captured: Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 HTTP/1.1 Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkZI7wqfqhenb_648vVkbU7_9xXoPQT3dkDAI39WK_2t8CxLRM826TsoFjfIESlb8HCbOtoL9VZCBBOtWMe-a1JZxg4Dt0wZ7b4cRIxG0wpJh-fMJr6EEK3vV9eWLalvvbajKprLDcM055bQ6fM8OOVAqlh07goHE2-rdHa8yvypTZc Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 9128d708b9c645cf914914a2378ff6ed Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-VolumesNegativeTest-610213714 Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:40:16.506379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9128d708b9c645cf914914a2378ff6ed", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9128d708b9c645cf914914a2378ff6ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9128d708b9c645cf914914a2378ff6ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9128d708b9c645cf914914a2378ff6ed"}]}] Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-VolumesNegativeTest-610213714 Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 9128d708b9c645cf914914a2378ff6ed Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-VolumesNegativeTest-610213714 Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-VolumesNegativeTest-610213714-project Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: d2f10d8db93a411d92b1e92fbd33a141 Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-VolumesNegativeTest-610213714-project Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 5284e905-c524-43ed-9d96-20e078df2a50 could not be found. Aug 24 15:40:16.508355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '5284e905-c524-43ed-9d96-20e078df2a50'} Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5284e905-c524-43ed-9d96-20e078df2a50 could not be found. Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:16.509497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5284e905-c524-43ed-9d96-20e078df2a50 could not be found. Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5284e905-c524-43ed-9d96-20e078df2a50 could not be found. Aug 24 15:40:16.511455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:16.514070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] Returning 404 to user: Instance 5284e905-c524-43ed-9d96-20e078df2a50 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:16.515296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6726340a-f796-4719-b0cb-1c01cd17aa19 tempest-VolumesNegativeTest-610213714 tempest-VolumesNegativeTest-610213714-project] 10.222.0.73 "GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50" status: 404 len: 111 microversion: 2.1 time: 0.047283 Aug 24 15:40:16.534371 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 174/350] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:16 2022] GET /compute/v2.1/servers/5284e905-c524-43ed-9d96-20e078df2a50 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:40:16.713436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:16.715189 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:16.729324 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:16.730055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:16.730704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:16.731576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:16.732467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:16.733070 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:16.821006 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:16.830025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0d57354a-cbd5-4c95-9678-5eda5a5d3794 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1297 microversion: 2.1 time: 0.121914 Aug 24 15:40:16.830898 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 177/351] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:16 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:17.238348 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:17.239202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:17.242053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:17.248055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:17.248907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:17.249729 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:17.250593 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:17.251235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:17.251893 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:17.464866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:17.474211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-af747286-1c3c-42a1-820c-637c38e243cd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.240540 Aug 24 15:40:17.478698 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 175/352] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:17 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:17.853972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:17.856678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:17.866686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:17.867355 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:17.867817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:17.868516 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:17.868967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:17.869394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:17.946105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:17.954133 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d4b4084a-b289-4017-965d-7e20becfb376 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1297 microversion: 2.1 time: 0.105392 Aug 24 15:40:17.955658 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 178/353] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:17 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:18.496490 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:18.497095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:18.505959 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:18.506442 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:18.512151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:18.512835 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:18.513358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:18.514085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:18.737176 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:18.749392 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4b37b4cf-f6c1-4a2c-83a0-c8e0e3421339 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.257424 Aug 24 15:40:18.749978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 176/354] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:18 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:18.981078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:18.982557 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:18.990837 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:18.991680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:18.993645 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:18.993645 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:18.994136 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:18.996160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:19.085777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:19.094025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-43d39bd4-fbed-4a35-ac8e-d7e4044a15fe tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1297 microversion: 2.1 time: 0.117077 Aug 24 15:40:19.095242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 179/355] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:18 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1297 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:19.775398 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:19.775398 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:19.782795 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:19.783289 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:19.783783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:19.784480 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:19.784930 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:19.785367 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:19.943204 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:19.953411 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a0a4f675-371c-4e10-80cb-3c74758c0313 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.186781 Aug 24 15:40:19.954478 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 177/356] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:19 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:20.116598 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:20.117875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:20.125187 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:20.125664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:20.126089 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:20.126819 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:20.127325 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:20.128475 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:20.193628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:20.202195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6ae0509e-338a-492d-b2d9-9d6917735203 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1297 microversion: 2.1 time: 0.089435 Aug 24 15:40:20.202794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 180/357] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:20 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:20.980923 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:20.981522 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:20.988932 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:20.989473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:20.989914 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:20.990854 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:20.991318 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:20.991748 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:21.143508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:21.153877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8a71e2c1-8449-49c2-85c2-4e7377993169 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.176810 Aug 24 15:40:21.154581 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 178/358] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:20 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:21.224784 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:21.225435 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:21.231968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:21.232733 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:21.233403 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:21.234114 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:21.234746 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:21.235177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:21.307383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:21.332176 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7afe3f5f-4752-47b3-9604-c18536ac7d15 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1297 microversion: 2.1 time: 0.112344 Aug 24 15:40:21.332815 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 181/359] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:21 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:22.177980 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:22.179273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:22.186295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:22.186826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:22.187265 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:22.187967 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:22.188420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:22.188844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:22.338072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:22.360954 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b0ded407-c328-42a1-aec8-22eb07ccb3c7 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.172871 Aug 24 15:40:22.360954 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 179/360] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:22 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:22.367226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:22.367837 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:22.374587 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:22.375096 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:22.375527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:22.376236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:22.376871 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:22.377375 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:22.442967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:22.450851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7b4395ff-d1ca-4734-9e35-b7bdc75d120d tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1297 microversion: 2.1 time: 0.087565 Aug 24 15:40:22.451426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 182/361] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:22 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:23.375424 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:23.376186 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:23.378149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:23.378838 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:23.385451 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:23.385931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:23.386363 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:23.387094 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:23.387541 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:23.387958 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:23.475347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:23.476346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:23.482309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=6 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:23.485204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:23.486227 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:23.486670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:23.487961 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:23.488409 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:23.488830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:23.539131 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:23.547826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3817c0e4-601e-4499-8bdc-bea90472b4ba tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.181092 Aug 24 15:40:23.548416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 180/362] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:23 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:23.558763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:23.566699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-91c7a0d1-f7eb-4839-934d-459331738c88 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1297 microversion: 2.1 time: 0.098786 Aug 24 15:40:23.567259 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 183/363] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:23 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:24.569641 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:24.570267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:24.576794 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:24.577273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:24.577709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:24.578425 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:24.579080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:24.579504 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:24.589709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:24.590417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:24.597602 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:24.598194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:24.598744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:24.600307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:24.600792 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:24.601232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:24.634285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:24.634806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:24.635246 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:24.635874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lazy-loading 'fault' on Instance uuid 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:40:24.691662 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff886c5f2516476e85e9e805aa19fece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1ee75d012f4378a607020154eaf0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:24.712673 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6891b3d1-d150-4cd8-9d49-ea98a9ec0b9b tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 200 len: 1302 microversion: 2.1 time: 0.127993 Aug 24 15:40:24.731541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 184/364] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:24 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 1302 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:24.741437 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-21b77078-2c7f-4534-897b-00e7824a5ce6 req-dd4f9212-87f3-436d-bc3e-a6d7bea3e1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d42888-8264-452f-ae88-fba52364c8c7", "tag": "c4f2df01-be68-4ea2-b398-f784a2bbe163"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:24.760793 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-21b77078-2c7f-4534-897b-00e7824a5ce6 req-dd4f9212-87f3-436d-bc3e-a6d7bea3e1a2 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:24.762725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-21b77078-2c7f-4534-897b-00e7824a5ce6 req-dd4f9212-87f3-436d-bc3e-a6d7bea3e1a2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:24.763391 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-21b77078-2c7f-4534-897b-00e7824a5ce6 req-dd4f9212-87f3-436d-bc3e-a6d7bea3e1a2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:24.786106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-21b77078-2c7f-4534-897b-00e7824a5ce6 req-dd4f9212-87f3-436d-bc3e-a6d7bea3e1a2 service nova] Creating event network-changed:c4f2df01-be68-4ea2-b398-f784a2bbe163 for instance 88d42888-8264-452f-ae88-fba52364c8c7 on hv-cinder-84605 Aug 24 15:40:24.792000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-21b77078-2c7f-4534-897b-00e7824a5ce6 req-dd4f9212-87f3-436d-bc3e-a6d7bea3e1a2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055794 Aug 24 15:40:24.792937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 185/365] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:24.805231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:24.812920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-dd40c534-45b6-4981-a488-b4cee7a665d4 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.248455 Aug 24 15:40:24.813495 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 181/366] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:24 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:25.738233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:25.738977 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] [instance: 5a66e7e7-cc2a-4da5-bf7c-320857fcd190] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:25.745639 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:25.746121 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:25.746556 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:25.747276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:25.747732 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:25.748153 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:25.762313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] HTTP exception thrown: Instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 could not be found. Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Request method failure captured: Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 HTTP/1.1 Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkYzlxtrstFo8vp6XN4MxR_LNQSLs9-9y6QgHxe2-63BJFrp1vTgsKUvRZy4eRqBkZY_DLrhpDoM4AeKqrHikcTv4II71zywXi7ROhDQA7c4oz49uj5x9oO-MDBw8_oo4d4jfCU4bLQ2DzYk9vaY4QTfms8_g3OurBA1Fh1swAsO8dI Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: df1ee75d012f4378a607020154eaf0b4 Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesActionsTest-655072483 Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:40:25.763970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_df1ee75d012f4378a607020154eaf0b4", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df1ee75d012f4378a607020154eaf0b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/df1ee75d012f4378a607020154eaf0b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/df1ee75d012f4378a607020154eaf0b4"}]}] Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesActionsTest-655072483 Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: df1ee75d012f4378a607020154eaf0b4 Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesActionsTest-655072483 Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesActionsTest-655072483-project Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: ff886c5f2516476e85e9e805aa19fece Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesActionsTest-655072483-project Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 could not be found. Aug 24 15:40:25.765496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '5a66e7e7-cc2a-4da5-bf7c-320857fcd190'} Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 could not be found. Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:25.766356 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 could not be found. Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 could not be found. Aug 24 15:40:25.768478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:40:25.769820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] Returning 404 to user: Instance 5a66e7e7-cc2a-4da5-bf7c-320857fcd190 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:25.769820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0e90e3e2-ce38-48c4-91d7-f5d2b26ef158 tempest-VolumesActionsTest-655072483 tempest-VolumesActionsTest-655072483-project] 10.222.0.73 "GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190" status: 404 len: 111 microversion: 2.1 time: 0.031550 Aug 24 15:40:25.769820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 186/367] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:25 2022] GET /compute/v2.1/servers/5a66e7e7-cc2a-4da5-bf7c-320857fcd190 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:40:25.834634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:25.835577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:25.842292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:25.842935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:25.843470 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:25.844264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:25.844818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:25.845342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:25.984341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:25.992537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f69ed043-d5eb-4b80-88bf-c8e57f955458 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.162962 Aug 24 15:40:25.993113 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 182/368] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:25 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:27.013318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:27.013934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:27.020973 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:27.021456 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:27.021888 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:27.022576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:27.023115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:27.023497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:27.164285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:27.171919 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c97ad92d-fdb2-40cf-b997-6fa8f51b49b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.162485 Aug 24 15:40:27.172483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 187/369] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:27 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:28.192909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:28.193552 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:28.200025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:28.200510 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:28.200948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:28.201645 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:28.202101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:28.202528 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:28.331359 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:28.339054 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3cbb7f0c-39a5-4000-8679-45005f6f575f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.150557 Aug 24 15:40:28.339632 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 183/370] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:28 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:29.359716 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:29.360326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:29.367390 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:29.367875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:29.368314 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:29.369008 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:29.369468 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:29.369898 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:29.506134 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:29.513879 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0c94faa2-d0f3-4a32-9e7e-b5ba6860c001 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.158025 Aug 24 15:40:29.515440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 188/371] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:29 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:30.535466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:30.536361 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:30.543495 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:30.544042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:30.544552 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:30.545291 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:30.545745 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:30.546335 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:30.566082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=100 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:30.685887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:30.694733 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c20a06f7-fb88-48b6-b09d-59bffc880e84 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.163948 Aug 24 15:40:30.698679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 184/372] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:30 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:31.717631 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:31.718337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:31.728983 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:31.729869 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:31.730460 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:31.731641 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:31.732576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:31.733115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:31.904242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:31.915205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1dd502df-b091-42d7-acb6-d5b351f82083 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.202443 Aug 24 15:40:31.916099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 189/373] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:31 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:32.937544 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:32.938402 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:32.945781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:32.946561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:32.947229 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:32.948124 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:32.948795 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:32.949367 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:33.117727 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:33.127129 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a6efefd3-3900-407a-95e2-6ee8af126a1f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.193447 Aug 24 15:40:33.128606 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 185/374] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:32 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:33.361080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-ff2dc9ec-a954-4750-9d58-2b423354c0ee req-0a6404d5-5824-4daf-924e-002f418a8be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d42888-8264-452f-ae88-fba52364c8c7", "name": "network-vif-plugged", "status": "completed", "tag": "c4f2df01-be68-4ea2-b398-f784a2bbe163"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:33.374370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ff2dc9ec-a954-4750-9d58-2b423354c0ee req-0a6404d5-5824-4daf-924e-002f418a8be2 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:33.378039 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ff2dc9ec-a954-4750-9d58-2b423354c0ee req-0a6404d5-5824-4daf-924e-002f418a8be2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:33.378039 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ff2dc9ec-a954-4750-9d58-2b423354c0ee req-0a6404d5-5824-4daf-924e-002f418a8be2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:33.388832 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-ff2dc9ec-a954-4750-9d58-2b423354c0ee req-0a6404d5-5824-4daf-924e-002f418a8be2 service nova] Creating event network-vif-plugged:c4f2df01-be68-4ea2-b398-f784a2bbe163 for instance 88d42888-8264-452f-ae88-fba52364c8c7 on hv-cinder-84605 Aug 24 15:40:33.400868 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-ff2dc9ec-a954-4750-9d58-2b423354c0ee req-0a6404d5-5824-4daf-924e-002f418a8be2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043566 Aug 24 15:40:33.401870 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 190/375] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:40:33.944191 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:33.948296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:33.959090 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:33.960252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:33.960821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:33.961782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:33.962349 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:33.963019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:34.101368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lazy-loading 'services' on Instance uuid 905f49ec-5f2b-4a83-994b-8d36385a9996 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:40:34.151870 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:34.153151 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:34.189873 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:34.191103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:34.191548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:34.192261 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:34.192802 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:34.193407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:34.237298 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fe6e17a4-79af-4ccf-a449-db959512af2c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-volume_attachments/7ed52da5-86bd-4da0-bfd8-fddeaa567190" status: 202 len: 0 microversion: 2.1 time: 0.297356 Aug 24 15:40:34.238144 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 186/376] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:40:33 2022] DELETE /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-volume_attachments/7ed52da5-86bd-4da0-bfd8-fddeaa567190 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:40:34.386087 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:34.396268 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ba4dbee1-eaaf-4f64-8234-cd2ed8009908 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1357 microversion: 2.1 time: 0.248838 Aug 24 15:40:34.398509 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 191/377] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:34 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:35.420724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:35.422188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:35.430019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:35.431174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:35.431944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:35.432815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:35.433428 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:35.434009 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:35.593134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:35.604321 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-87b1002f-e961-46a6-a1fa-d86d79a7763a tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1548 microversion: 2.1 time: 0.189337 Aug 24 15:40:35.604963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 187/378] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:35 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:35.627243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:35.628673 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:35.636297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:35.636829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:35.637283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:35.638017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:35.638473 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:35.638966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:35.643952 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=100 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:35.795385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:35.805580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e1de0f21-0d56-456a-af15-46c80e14a1bd tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1548 microversion: 2.1 time: 0.182097 Aug 24 15:40:35.806656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 192/379] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:35 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:35.826439 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:35.832517 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:35.833288 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Searching by: {'deleted': False, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5'} {{(pid=132288) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 15:40:35.852687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:35.853767 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:35.854611 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:35.864342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:35.864964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:35.865434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:35.986625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.multi_cell_list [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 15:40:36.100725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-31a8960a-8ec8-4a50-a972-18329a3b53be tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.278021 Aug 24 15:40:36.101524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 188/380] 10.222.0.73 () {58 vars in 1125 bytes} [Wed Aug 24 15:40:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:36.113132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:36.113664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:36.120083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:36.120572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:36.121252 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:36.122233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:36.122964 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:36.123555 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:36.298498 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:36.309703 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4ec54aa8-7409-4f7e-9dcb-898b4f1a0ebc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1548 microversion: 2.1 time: 0.200526 Aug 24 15:40:36.319907 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 193/381] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:36 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1548 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:36.471164 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-df30510e-b107-4b03-b021-97afd783f7b9 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:36.479044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df30510e-b107-4b03-b021-97afd783f7b9 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:36.479534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df30510e-b107-4b03-b021-97afd783f7b9 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:36.479967 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df30510e-b107-4b03-b021-97afd783f7b9 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:36.509322 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-df30510e-b107-4b03-b021-97afd783f7b9 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Going to try to stop instance {{(pid=132288) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 15:40:36.560864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-df30510e-b107-4b03-b021-97afd783f7b9 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action" status: 202 len: 0 microversion: 2.1 time: 0.093014 Aug 24 15:40:36.575336 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:36.576580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:36.580062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 189/382] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:40:36 2022] POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:40:36.592632 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:36.593508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:36.594534 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:36.595798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:36.596964 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:36.597597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:36.790134 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:36.801023 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-dda11c0b-5234-432d-be2b-b5cea6fa2656 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.233550 Aug 24 15:40:36.801823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 194/383] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:36 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:37.825062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:37.825985 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:37.833602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:37.834092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:37.834548 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:37.835291 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:37.836134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:37.836756 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:38.010970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:38.013149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f73bf507-9e3d-4102-94aa-51c56838b4d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.193492 Aug 24 15:40:38.013953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 190/384] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:37 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:38.184590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa924272-ea78-45ea-8ab1-571ef138ee3b"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:38.187801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:38.195716 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:38.196425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:38.196865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:38.197819 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:38.198452 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:38.198907 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:38.544177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c86f89be-c99b-46ef-b5eb-13a1121eeb55 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363479 Aug 24 15:40:38.551099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 195/385] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:40:38 2022] POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:39.038182 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:39.038828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:39.046220 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:39.047324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:39.047986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:39.049100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:39.050313 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:39.051055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:39.231537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:39.239386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0fc5c401-3472-45f7-8d20-13888ab48a77 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.205541 Aug 24 15:40:39.239984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 191/386] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:39 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:40.262315 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:40.263715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:40.271279 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:40.271784 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:40.272222 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:40.273060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:40.273702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:40.274287 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:40.439559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:40.449009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3653854d-39ae-4c30-bb3c-86126062912d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.191404 Aug 24 15:40:40.449830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 196/387] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:40 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:41.470632 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:41.472916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:41.480370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:41.480965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:41.481691 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:41.482440 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:41.483025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:41.483598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:41.632741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:41.641217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f5062905-51c7-49b2-887f-cbcb6e7a3cdd tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.174517 Aug 24 15:40:41.641801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 192/388] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:41 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:42.667649 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:42.668934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:42.676798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:42.677370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:42.677878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:42.678702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:42.679230 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:42.679902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:42.821823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:42.830560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9ad81f31-a0dd-441e-861b-494f7fa9d799 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.168096 Aug 24 15:40:42.831809 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 197/389] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:42 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:43.033232 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c7bff9f-3c70-4bab-8672-9c24f67feab5"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:43.037278 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:43.043998 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:43.044742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:43.045398 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:43.046458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:43.047167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:43.047782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:43.354706 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-49d4eef8-2be6-466f-abca-0f79ca86abe6 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325988 Aug 24 15:40:43.355868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 193/390] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:40:43 2022] POST /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:43.855419 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:43.856449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:43.859809 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:43.866968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:43.867990 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:43.868863 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:43.869817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:43.870621 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:43.871285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:44.055273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:44.068414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b47f1bf5-7d95-4484-8797-2ef7c59b002d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.218045 Aug 24 15:40:44.069010 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 198/391] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:43 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:45.091170 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:45.091962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:45.098963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:45.099444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:45.099904 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:45.100852 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:45.101299 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:45.101713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:45.320158 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:45.336641 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c5c1907c-087d-4470-acba-06b76f9c3cbb tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.250191 Aug 24 15:40:45.337235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 194/392] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:45 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:46.223207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:46.223858 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:46.230737 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:46.231232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:46.231749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:46.232455 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:46.232910 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:46.233331 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:46.368632 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:46.369289 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:46.372887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:46.376999 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:46.377490 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:46.377997 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:46.378742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:46.379196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:46.379710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:46.384501 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:46.394922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-fa2f014f-7add-42e2-9476-a32d73b90e2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1594 microversion: 2.1 time: 0.175458 Aug 24 15:40:46.395958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 199/393] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:46 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1594 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:46.524325 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:46.532933 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e00b2acf-ae92-467c-bb20-db264b9e95c3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1676 microversion: 2.1 time: 0.168139 Aug 24 15:40:46.533761 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 195/394] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:46 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:47.556326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:47.556922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:47.563370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:47.563860 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:47.564297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:47.564987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:47.565771 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:47.566211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:48.059691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:48.067720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3d72b2f9-8d16-4d3e-bd66-2fd37259d0e4 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1653 microversion: 2.1 time: 0.515318 Aug 24 15:40:48.068286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 200/395] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:47 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1653 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:48.089822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-188a9cbf-54c3-4990-a64b-1777468ca628 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:48.092269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=42 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:48.098153 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-188a9cbf-54c3-4990-a64b-1777468ca628 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:48.098632 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-188a9cbf-54c3-4990-a64b-1777468ca628 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:48.099145 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-188a9cbf-54c3-4990-a64b-1777468ca628 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:48.121449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-188a9cbf-54c3-4990-a64b-1777468ca628 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Going to try to start instance {{(pid=132288) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 15:40:48.154353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:48.164307 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-188a9cbf-54c3-4990-a64b-1777468ca628 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action" status: 202 len: 0 microversion: 2.1 time: 0.078246 Aug 24 15:40:48.164884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 196/396] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:40:48 2022] POST /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:40:48.174176 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:48.175353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:48.182772 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:48.183312 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:48.183867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:48.184691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:48.185439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:48.186871 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:48.500092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:48.523295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-26f29ac4-699d-4146-ba73-5fa976c79c1e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1662 microversion: 2.1 time: 0.347249 Aug 24 15:40:48.524309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 201/397] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:48 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1662 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:49.068730 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-5f57b686-346a-4c89-9a0c-6ed61e578b86 req-32a5c765-e53a-4ac4-9104-84f74d21b2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d42888-8264-452f-ae88-fba52364c8c7", "tag": "c4f2df01-be68-4ea2-b398-f784a2bbe163"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:49.088211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-5f57b686-346a-4c89-9a0c-6ed61e578b86 req-32a5c765-e53a-4ac4-9104-84f74d21b2e3 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.088745 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-5f57b686-346a-4c89-9a0c-6ed61e578b86 req-32a5c765-e53a-4ac4-9104-84f74d21b2e3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.089315 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-5f57b686-346a-4c89-9a0c-6ed61e578b86 req-32a5c765-e53a-4ac4-9104-84f74d21b2e3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.102247 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-5f57b686-346a-4c89-9a0c-6ed61e578b86 req-32a5c765-e53a-4ac4-9104-84f74d21b2e3 service nova] Creating event network-changed:c4f2df01-be68-4ea2-b398-f784a2bbe163 for instance 88d42888-8264-452f-ae88-fba52364c8c7 on hv-cinder-84605 Aug 24 15:40:49.108205 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-5f57b686-346a-4c89-9a0c-6ed61e578b86 req-32a5c765-e53a-4ac4-9104-84f74d21b2e3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053390 Aug 24 15:40:49.108948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 197/398] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:49.192802 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:49.196239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:49.209029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.210211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.211288 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.212689 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.213872 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.214606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.246875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b230a044-e7ae-424e-a1c6-93323b45686c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.069444 Aug 24 15:40:49.247719 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 202/399] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:40:49 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2/ips => generated 150 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:49.262065 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10549d70-5fa0-4493-8639-741be82396da"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:49.265180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:49.274002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.274708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.275302 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.276311 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.277224 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.277807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.406154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Invalid volume: volume 10549d70-5fa0-4493-8639-741be82396da is already attached to instances: d719a892-4ac9-42ad-973b-ecc96a5df4a6 Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: POST /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2/os-volume_attachments HTTP/1.1 Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 74 Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:40:49.407938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {"volumeAttachment": {"volumeId": "10549d70-5fa0-4493-8639-741be82396da"}} Aug 24 15:40:49.409376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Invalid volume: volume 10549d70-5fa0-4493-8639-741be82396da is already attached to instances: d719a892-4ac9-42ad-973b-ecc96a5df4a6 Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'server_id': 'f7f35f56-4bfe-416c-861e-c49c02f623c2', 'body': {'volumeAttachment': {'volumeId': '10549d70-5fa0-4493-8639-741be82396da'}}} Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 10549d70-5fa0-4493-8639-741be82396da is already attached to instances: d719a892-4ac9-42ad-973b-ecc96a5df4a6 Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:49.410569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 10549d70-5fa0-4493-8639-741be82396da is already attached to instances: d719a892-4ac9-42ad-973b-ecc96a5df4a6 Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:49.412434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 10549d70-5fa0-4493-8639-741be82396da is already attached to instances: d719a892-4ac9-42ad-973b-ecc96a5df4a6 Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 400 to user: Invalid volume: volume 10549d70-5fa0-4493-8639-741be82396da is already attached to instances: d719a892-4ac9-42ad-973b-ecc96a5df4a6 {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8eb44d1d-9ba2-4b61-bb01-aa2e09702c05 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153001 Aug 24 15:40:49.415741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 198/400] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:40:49 2022] POST /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:40:49.419545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:49.420311 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:49.427972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.428846 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.429274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.430489 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.431125 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.431549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.461101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:40:49.545218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:49.546036 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:49.554206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.555120 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.555755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.556674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.557467 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.558128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.568040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b4a1a8b4-9aeb-4898-862b-a606bb758b3c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 204 len: 0 microversion: 2.1 time: 0.151908 Aug 24 15:40:49.572667 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 203/401] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:40:49 2022] DELETE /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:40:49.581159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:49.583313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:49.593942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.594471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.594941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.595982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:49.596454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:49.597627 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:49.887648 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:49.916402 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-64e0096b-06fc-48a0-9a15-38a642439892 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1662 microversion: 2.1 time: 0.374730 Aug 24 15:40:49.917108 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 199/402] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:49 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1662 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:49.947205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:49.956145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7417ac00-0804-4c29-8275-cb2065fc8101 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1681 microversion: 2.1 time: 0.381549 Aug 24 15:40:49.959344 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 204/403] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:49 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1681 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:50.562081 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-285554069"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:50.562603 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:50.569643 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:50.570127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:50.570565 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:50.571272 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:50.571723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:50.572147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:50.705168 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.network.security_group_api [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Adding security group 19129c0c-0209-4609-ae42-a24e14085421 to port c4f2df01-be68-4ea2-b398-f784a2bbe163 Aug 24 15:40:50.942389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:50.943016 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:50.954483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:50.954993 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:50.955420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:50.956339 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:50.956853 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:50.957274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:51.176296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-13b80c66-cfbd-48dc-8fdf-a251511ecd36 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/action" status: 202 len: 0 microversion: 2.1 time: 0.617874 Aug 24 15:40:51.177760 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 200/404] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:40:50 2022] POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:40:51.184339 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:51.185787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:51.192114 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:51.192742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:51.193286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:51.196705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:51.197297 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:51.197896 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:51.203072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:51.215201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-55589506-ae58-42e5-ae7c-cf54ceb72160 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1666 microversion: 2.1 time: 0.277139 Aug 24 15:40:51.217052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 205/405] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:50 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1666 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:51.229803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:51.230826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:51.251736 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:51.254781 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:51.255305 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:51.256749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:51.257671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:51.258243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:51.263890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:51.433337 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:51.447330 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0dafa870-9d4f-4881-9208-9c99659b2f86 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1681 microversion: 2.1 time: 0.268506 Aug 24 15:40:51.450770 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 201/406] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:51 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:51.455595 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-7c935066-cfbe-4fde-8582-ddfe43d453c3 req-d034f1f2-089a-4361-b785-e17eff2a039a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d42888-8264-452f-ae88-fba52364c8c7", "tag": "c4f2df01-be68-4ea2-b398-f784a2bbe163"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:51.470484 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7c935066-cfbe-4fde-8582-ddfe43d453c3 req-d034f1f2-089a-4361-b785-e17eff2a039a service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:51.471293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7c935066-cfbe-4fde-8582-ddfe43d453c3 req-d034f1f2-089a-4361-b785-e17eff2a039a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:51.471962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7c935066-cfbe-4fde-8582-ddfe43d453c3 req-d034f1f2-089a-4361-b785-e17eff2a039a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:51.485744 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-7c935066-cfbe-4fde-8582-ddfe43d453c3 req-d034f1f2-089a-4361-b785-e17eff2a039a service nova] Creating event network-changed:c4f2df01-be68-4ea2-b398-f784a2bbe163 for instance 88d42888-8264-452f-ae88-fba52364c8c7 on hv-cinder-84605 Aug 24 15:40:51.495790 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-7c935066-cfbe-4fde-8582-ddfe43d453c3 req-d034f1f2-089a-4361-b785-e17eff2a039a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043420 Aug 24 15:40:51.496634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 202/407] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:51.500535 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:51.510020 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b7a1ef40-c747-43c8-a5bd-d944826eb05e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1640 microversion: 2.1 time: 0.291608 Aug 24 15:40:51.510752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 206/408] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:51 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1640 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:52.469172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:52.469865 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:52.477170 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:52.478074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:52.478728 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:52.479590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:52.480193 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:52.480779 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:52.632886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:52.641739 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a68b42e4-fb34-4854-9d7b-8c832494a3e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1681 microversion: 2.1 time: 0.177150 Aug 24 15:40:52.642412 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 203/409] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:52 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:53.175720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:53.178086 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:53.189908 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:53.190500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:53.190965 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:53.191666 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:53.192292 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:53.192903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:53.217920 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lazy-loading 'flavor' on Instance uuid 8dd8a365-ce5e-405e-8b76-93303538f94e {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:40:53.399270 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-01bcb09c-2c49-49da-b0b6-68fd76af3897 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/action" status: 200 len: 32 microversion: 2.1 time: 0.228400 Aug 24 15:40:53.400020 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 207/410] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:40:53 2022] POST /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:40:53.410770 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:53.411401 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:53.418449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:53.419231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:53.419667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:53.420379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:53.420830 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:53.421249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:53.668402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:53.669108 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:53.687100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:53.687532 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:53.687982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:53.688077 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:53.688822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:53.689283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:53.689706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:53.701970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ec766cad-e9b7-42b6-90db-093dfd97fef8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.295632 Aug 24 15:40:53.703882 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 204/411] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:53 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:53.795873 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:53.804334 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d2f4770b-5ec0-49dc-9210-cf92b892a92c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 200 len: 1613 microversion: 2.1 time: 0.139947 Aug 24 15:40:53.805177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 208/412] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:53 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 1613 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:53.942166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-2e999555-3428-4223-bbf2-c45b62ca2921 req-9b482255-e354-4c80-9830-cebb05460a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f35f56-4bfe-416c-861e-c49c02f623c2", "name": "network-vif-deleted", "tag": "5a903b96-7262-4382-b289-851e17d994de"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:53.957743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-2e999555-3428-4223-bbf2-c45b62ca2921 req-9b482255-e354-4c80-9830-cebb05460a94 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:53.959583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-2e999555-3428-4223-bbf2-c45b62ca2921 req-9b482255-e354-4c80-9830-cebb05460a94 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:53.960402 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-2e999555-3428-4223-bbf2-c45b62ca2921 req-9b482255-e354-4c80-9830-cebb05460a94 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:53.979859 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-2e999555-3428-4223-bbf2-c45b62ca2921 req-9b482255-e354-4c80-9830-cebb05460a94 service nova] Creating event network-vif-deleted:5a903b96-7262-4382-b289-851e17d994de for instance f7f35f56-4bfe-416c-861e-c49c02f623c2 on hv-cinder-84605 Aug 24 15:40:53.986342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-2e999555-3428-4223-bbf2-c45b62ca2921 req-9b482255-e354-4c80-9830-cebb05460a94 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064524 Aug 24 15:40:53.988252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 205/413] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:54.729333 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:54.729947 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:54.736487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:54.736976 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:54.737925 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:54.738614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:54.739163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:54.739580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:54.828599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:54.829297 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:54.837038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:54.837731 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:54.838571 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:54.839462 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:54.840177 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:54.840755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:54.863628 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 HTTP/1.1 Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:40:54.865427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:40:54.867104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'f7f35f56-4bfe-416c-861e-c49c02f623c2'} Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:40:54.867957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:40:54.869382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:40:54.870613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:40:54.870613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6ef3a0f8-dde2-474c-b613-41ee4a2643f9 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 404 len: 111 microversion: 2.1 time: 0.043463 Aug 24 15:40:54.870613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 206/414] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:54 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:40:54.875615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1ffeea31-6512-4723-9066-1ee869e13074 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '.version_select at 0x7f07902a2d30>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:54.900429 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1ffeea31-6512-4723-9066-1ee869e13074 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435109361" status: 202 len: 0 microversion: 2.1 time: 0.028308 Aug 24 15:40:54.901172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 207/415] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 15:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435109361 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:40:54.911263 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:54.926034 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-56b2d600-b26f-4097-b6da-8eb841212c93 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.199989 Aug 24 15:40:54.926656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 209/416] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:54 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:55.950999 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:55.950999 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:55.955139 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:55.955890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:55.956853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:55.957902 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:55.958578 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:55.959384 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:55.962946 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:55.963425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:55.970187 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:55.970897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:55.971550 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:55.973591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:55.974255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:55.974893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:56.109752 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:56.120806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-61691db2-53ca-41ce-94b4-e540d7a30b36 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.177433 Aug 24 15:40:56.122805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 208/417] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:55 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:56.124412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lazy-loading 'services' on Instance uuid d719a892-4ac9-42ad-973b-ecc96a5df4a6 {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:40:56.247984 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3c2c6e63-82ba-428f-9f0d-a571a05bd838 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments/10549d70-5fa0-4493-8639-741be82396da" status: 202 len: 0 microversion: 2.1 time: 0.288823 Aug 24 15:40:56.248900 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 210/418] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:40:55 2022] DELETE /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments/10549d70-5fa0-4493-8639-741be82396da => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:40:56.258663 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:56.261116 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:56.268168 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:56.269152 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:56.269743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:56.270440 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:56.271074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:56.271499 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:56.303847 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2773200a-3a44-4d21-8caa-992d7267ea26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050611 Aug 24 15:40:56.304863 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 209/419] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:40:56 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:40:57.144549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:57.145353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:57.151634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.152120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.152562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.153257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.153712 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.154138 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.286345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:57.294589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2b8a5af7-44cf-4b6b-95e6-a368d007f162 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.155327 Aug 24 15:40:57.295192 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 211/420] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:57 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:57.317681 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:57.319869 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:57.327046 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.327550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.327985 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.328685 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.329145 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.329569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.359797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8f8f5c20-5fba-4d63-b8e9-449247b747d1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046767 Aug 24 15:40:57.360368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 210/421] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:40:57 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:40:57.433307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:57.433956 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:57.440143 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.441215 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.441596 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.442397 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.442878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.443366 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.469053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:40:57.558858 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a6da03b7-9c92-4270-9553-68b4e1b2d8ac tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 204 len: 0 microversion: 2.1 time: 0.128839 Aug 24 15:40:57.560110 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 212/422] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:40:57 2022] DELETE /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:40:57.569413 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:57.570378 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:57.576729 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.577219 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.577658 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.578569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.579060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.579489 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.718789 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:57.727015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7b56f325-5df9-475f-8e51-bc2c6f615f4c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1680 microversion: 2.1 time: 0.162342 Aug 24 15:40:57.727608 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 211/423] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:57 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:58.315897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:58.316507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:58.323135 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:58.323612 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:58.324041 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:58.325182 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:58.325307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:58.325722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:58.456977 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:58.465351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c9cfac77-d73a-4248-ab83-04b0583791dc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.153798 Aug 24 15:40:58.465944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 213/424] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:58 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:58.748685 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:58.749293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:58.755945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:58.756419 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:58.756844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:58.757520 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:58.757970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:58.758382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:58.890466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:58.898765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9bcd6b71-645a-4870-97d0-9ec0c17f5f45 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1680 microversion: 2.1 time: 0.154096 Aug 24 15:40:58.899327 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 212/425] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:58 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:59.488041 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:59.488645 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:59.495037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:59.495519 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:59.495948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:59.496638 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:59.497109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:59.497511 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:59.747650 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:59.756364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ab71f8ca-4c82-4940-94cc-8fc033f1754d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.272714 Aug 24 15:40:59.756944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 214/426] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:59 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:59.920369 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:59.921712 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:59.929642 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:59.930130 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:59.930567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:59.931320 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:59.931775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:59.932213 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:00.011498 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:00.021388 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-17e94590-4a35-4866-a2ef-407b267a2822 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 200 len: 1612 microversion: 2.1 time: 0.105419 Aug 24 15:41:00.021963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 213/427] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:59 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 1612 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:00.227278 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-3f568c36-4508-46f2-ad59-91eb6b726e4a req-26075738-3c8a-449f-98a3-2129f0f3aa1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d719a892-4ac9-42ad-973b-ecc96a5df4a6", "name": "network-vif-deleted", "tag": "0343d105-5766-479e-80bd-69cf5533dd7a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:00.239491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-3f568c36-4508-46f2-ad59-91eb6b726e4a req-26075738-3c8a-449f-98a3-2129f0f3aa1c service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:00.240617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-3f568c36-4508-46f2-ad59-91eb6b726e4a req-26075738-3c8a-449f-98a3-2129f0f3aa1c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:00.240896 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-3f568c36-4508-46f2-ad59-91eb6b726e4a req-26075738-3c8a-449f-98a3-2129f0f3aa1c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:00.254322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-3f568c36-4508-46f2-ad59-91eb6b726e4a req-26075738-3c8a-449f-98a3-2129f0f3aa1c service nova] Creating event network-vif-deleted:0343d105-5766-479e-80bd-69cf5533dd7a for instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 on hv-cinder-84605 Aug 24 15:41:00.259464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-3f568c36-4508-46f2-ad59-91eb6b726e4a req-26075738-3c8a-449f-98a3-2129f0f3aa1c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037020 Aug 24 15:41:00.260238 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 215/428] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:00.778345 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:00.779186 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:00.787967 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:00.788592 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:00.789100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:00.790278 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:00.790845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:00.791346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:00.933762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:00.943850 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-10361785-9096-48d9-9847-1ff807d8026f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.169724 Aug 24 15:41:00.944590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 214/429] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:00 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:01.044189 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:01.044888 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:01.051544 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:01.052042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:01.052477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:01.053207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:01.053664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:01.054097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:01.069474 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 HTTP/1.1 Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:41:01.071208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:41:01.072726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'd719a892-4ac9-42ad-973b-ecc96a5df4a6'} Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:41:01.073560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:41:01.074948 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:01.076210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:41:01.076210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-384bb334-e96b-4abb-b3b0-3e17524b6def tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 404 len: 111 microversion: 2.1 time: 0.033206 Aug 24 15:41:01.076708 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 216/430] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:01 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:41:01.085179 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1c8face3-8edd-4236-83ed-0e8e29989db1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '.version_select at 0x7f0783501820>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:01.105900 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1c8face3-8edd-4236-83ed-0e8e29989db1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1880189419" status: 202 len: 0 microversion: 2.1 time: 0.025360 Aug 24 15:41:01.106574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 215/431] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 15:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1880189419 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:41:01.774858 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0fdb731d-8638-44b7-bb2f-2074612781dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: .version_select at 0x7f07907b4310>, body: {"keypair": {"name": "tempest-keypair-467759548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbO2LSPbEUiq1zot/EzcrMTNvS4beqLGr9gyFCEC+P/14XMxiBsrs8O2aATJyjkP1/HmUBf6QxWaC7NdmkxExJf7F1GOFsqNu03t4QNNCMHY5esksl+o3qQUBXMVTyVWQ=="}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:01.792744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-0fdb731d-8638-44b7-bb2f-2074612781dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:41:01.798704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-0fdb731d-8638-44b7-bb2f-2074612781dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:41:01.828596 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0fdb731d-8638-44b7-bb2f-2074612781dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057775 Aug 24 15:41:01.829547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 217/432] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:41:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:01.979358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:01.980187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:01.991401 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:01.991893 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:01.992327 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:01.993625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:01.994089 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:01.994515 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:02.218047 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:02.228299 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-21fe2360-5a01-4c99-aeec-1fba53648bb3 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.266671 Aug 24 15:41:02.229346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 216/433] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:01 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:03.252142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:03.252754 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:03.263784 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:03.264278 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:03.264720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:03.265418 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:03.265867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:03.266437 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:03.387414 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1026832293", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105210c5-8b78-4e8c-bd12-9456d560212d"}], "security_groups": [{"name": "tempest-securitygroup--775458075"}], "key_name": "tempest-keypair-467759548", "user_data": "}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:03.576636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:03.585929 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7927fbd6-e923-4d2a-b0e7-5279c101663b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.338225 Aug 24 15:41:03.586692 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 218/434] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:03 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:03.609646 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] validate_networks() for [('105210c5-8b78-4e8c-bd12-9456d560212d', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:41:04.110845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:41:04.111268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:41:04.111768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:41:04.112177 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:41:04.113457 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:41:04.122385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:04.122895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:04.123328 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:04.124052 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:04.124609 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:04.124910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:04.141977 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:41:04.146006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:41:04.157599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:41:04.160909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:41:04.217016 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-681c5eb8-1604-4f27-9692-73a7cd3952bd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.833864 Aug 24 15:41:04.217974 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 217/435] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:41:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:41:04.229461 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-34f7d426-9d10-4c87-bcda-4b45eb8557c8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:04.230065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-34f7d426-9d10-4c87-bcda-4b45eb8557c8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:04.294878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-34f7d426-9d10-4c87-bcda-4b45eb8557c8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:04.303073 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-34f7d426-9d10-4c87-bcda-4b45eb8557c8 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1241 microversion: 2.1 time: 0.077585 Aug 24 15:41:04.303840 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 219/436] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:04 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:04.609101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:04.609711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:04.618354 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:04.619060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:04.619576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:04.620664 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:04.621168 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:04.621845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:04.759654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:04.770485 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-775b5c1e-85d1-46e0-976b-55356d2aa5d1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.165302 Aug 24 15:41:04.771331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 218/437] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:04 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:05.324915 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:05.326129 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:05.334250 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:05.335007 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:05.335440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:05.336429 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:05.336750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:05.337326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:05.407852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:05.415952 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f0401344-0cd8-4d4f-a2d0-99ab66fc725e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1311 microversion: 2.1 time: 0.094815 Aug 24 15:41:05.416534 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 220/438] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:05 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:05.574378 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2111758320", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "networks": [{"uuid": "16e26aa1-fc84-40ef-9164-bff00905970c"}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:05.630181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] validate_networks() for [('16e26aa1-fc84-40ef-9164-bff00905970c', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:41:05.791963 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:05.792619 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:05.798741 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:05.799228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:05.799665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:05.800991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:05.801446 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:05.801868 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:06.095162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:06.099727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:06.105731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-da5185e1-e4ab-4d62-a2d9-a07f894421a2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.317557 Aug 24 15:41:06.106309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 221/439] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:05 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:06.437333 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:06.438052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:06.446468 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:06.446981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:06.447417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:06.448111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:06.448566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:06.448986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:06.505997 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:41:06.506429 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:41:06.506940 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:41:06.507350 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:41:06.507760 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:41:06.516731 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:06.517235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:06.517881 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:06.518613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:06.519382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:06.520040 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:06.527223 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=100 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:06.527383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:06.536037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9c0244dd-f260-4811-84ff-479d7ecb0e34 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1299 microversion: 2.1 time: 0.102476 Aug 24 15:41:06.537035 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 222/440] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:06 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:06.539781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Getting quotas for project 0b578ad7d48e406fabfc32450de322d1. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:41:06.543817 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Getting quotas for user 685fc311a8c14573b19719fb093e3ee2 and project 0b578ad7d48e406fabfc32450de322d1. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:41:06.555692 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:41:06.557764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:41:06.605483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4e7d467f-6d3f-4ee1-a5ba-4814c17d9005 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035743 Aug 24 15:41:06.606465 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 219/441] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:41:06.617494 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-99438c30-ed19-4602-a89b-f4a805f03db4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:06.618120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-99438c30-ed19-4602-a89b-f4a805f03db4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:06.712161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-99438c30-ed19-4602-a89b-f4a805f03db4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:06.724255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-99438c30-ed19-4602-a89b-f4a805f03db4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1219 microversion: 2.1 time: 0.111101 Aug 24 15:41:06.725702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 223/442] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:06 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:07.130721 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:07.133195 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:07.144882 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.145528 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.146049 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.147723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.148184 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.148892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.375943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:07.385085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5417f276-aa51-4761-84d5-ac9176f6be7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.259719 Aug 24 15:41:07.385666 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 220/443] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:07 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:07.453236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-812f3be3-6d0d-4592-bcd7-4ff188f5164d req-4689df64-ec07-4b75-9e69-9fcd24ce8b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b", "tag": "b97df505-95e6-44e6-b833-4fc18dc0cdf2"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:07.464678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-812f3be3-6d0d-4592-bcd7-4ff188f5164d req-4689df64-ec07-4b75-9e69-9fcd24ce8b91 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.465158 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-812f3be3-6d0d-4592-bcd7-4ff188f5164d req-4689df64-ec07-4b75-9e69-9fcd24ce8b91 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.465589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-812f3be3-6d0d-4592-bcd7-4ff188f5164d req-4689df64-ec07-4b75-9e69-9fcd24ce8b91 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.480970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-812f3be3-6d0d-4592-bcd7-4ff188f5164d req-4689df64-ec07-4b75-9e69-9fcd24ce8b91 service nova] Creating event network-changed:b97df505-95e6-44e6-b833-4fc18dc0cdf2 for instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b on hv-cinder-84605 Aug 24 15:41:07.485917 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-812f3be3-6d0d-4592-bcd7-4ff188f5164d req-4689df64-ec07-4b75-9e69-9fcd24ce8b91 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036435 Aug 24 15:41:07.486527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 224/444] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:07.558357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:07.559005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:07.568150 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.568717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.569374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.570268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.570872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.571314 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.751273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:07.751983 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:07.759780 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.760512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.761099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.761954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.762595 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.763403 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.882153 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:07.892408 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-80fa8aaf-6665-4291-b71b-7f1aea7b6adb tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1289 microversion: 2.1 time: 0.149551 Aug 24 15:41:07.893562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 225/445] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:07 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:07.900320 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:07.907765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0465bc26-c575-44a3-b408-eb6b1115674f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1366 microversion: 2.1 time: 0.353326 Aug 24 15:41:07.908337 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 221/446] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:07 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:08.407465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:08.408113 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:08.414989 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.415482 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.415932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:08.416663 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.417125 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.417552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:08.610283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:08.620240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c660de72-d3f6-42d6-8628-9fd07b143005 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.216720 Aug 24 15:41:08.621160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 226/447] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:08 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:08.914483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:08.915245 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:08.922093 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.922474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.922952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:08.923654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.924070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.924701 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:08.932474 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:08.933433 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:08.944826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.945327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.945997 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:08.947160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.947776 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.948222 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:09.137828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:09.141942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:09.146103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-77dc261f-8eb8-40cc-99ae-ae694db04cf2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.236365 Aug 24 15:41:09.146694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 222/448] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:08 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:09.150451 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ea4ecd16-f2c3-4343-9ae1-50b9ec02c00d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1366 microversion: 2.1 time: 0.222837 Aug 24 15:41:09.151113 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-3cd5c46a-1713-4368-b1a1-686a41096107 req-cb7a17b7-501b-4bc9-b150-40ddd64a10f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3e2044-e4e4-493a-afc5-c7de2fe009e9", "tag": "66ef2e63-7ae1-45ca-bc1b-3eb35bd0a892"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:09.156674 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 227/449] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:08 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:09.162251 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-3cd5c46a-1713-4368-b1a1-686a41096107 req-cb7a17b7-501b-4bc9-b150-40ddd64a10f3 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:09.162613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-3cd5c46a-1713-4368-b1a1-686a41096107 req-cb7a17b7-501b-4bc9-b150-40ddd64a10f3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:09.163143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-3cd5c46a-1713-4368-b1a1-686a41096107 req-cb7a17b7-501b-4bc9-b150-40ddd64a10f3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:09.174069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-3cd5c46a-1713-4368-b1a1-686a41096107 req-cb7a17b7-501b-4bc9-b150-40ddd64a10f3 service nova] Creating event network-changed:66ef2e63-7ae1-45ca-bc1b-3eb35bd0a892 for instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 on hv-cinder-84605 Aug 24 15:41:09.179929 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-3cd5c46a-1713-4368-b1a1-686a41096107 req-cb7a17b7-501b-4bc9-b150-40ddd64a10f3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032126 Aug 24 15:41:09.180534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 223/450] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:09.641832 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:09.642443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:09.649392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:09.649883 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:09.650321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:09.651045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:09.651505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:09.651932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:09.781704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:09.790735 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e4ffb960-9d84-426c-9e7f-04086a98ae7a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.152676 Aug 24 15:41:09.791401 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 228/451] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:09 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:10.170888 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:10.171617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:10.171727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:10.172260 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:10.178267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:10.178414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:10.178700 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:10.178917 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:10.179157 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:10.179346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:10.179825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:10.180543 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:10.180656 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:10.180750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:10.180828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:10.180902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:10.613033 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:10.620781 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2ea8950d-5856-4da2-9a79-c4ce5dd5f546 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1366 microversion: 2.1 time: 0.452870 Aug 24 15:41:10.621562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 229/452] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:10 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:10.624797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:10.632569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4fdd9f09-c458-4196-b46c-67912c9eda0a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.466670 Aug 24 15:41:10.633135 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 224/453] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:10 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:10.811236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:10.811779 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:10.818843 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:10.819322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:10.819798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:10.820481 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:10.820939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:10.821632 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:10.950582 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:10.959367 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6cc335f3-afe8-4d01-a6f6-8a3d71a886e4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.152163 Aug 24 15:41:10.959939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 230/454] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:10 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:11.641752 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:11.642362 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:11.649537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:11.650105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:11.650570 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:11.651300 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:11.651764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:11.652983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:11.655418 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:11.656037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:11.662867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:11.663582 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:11.664249 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:11.664954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:11.665411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:11.665836 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:11.868011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:11.870908 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:11.875768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a570ede4-d887-41b4-98ca-44e7bb8db960 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1366 microversion: 2.1 time: 0.237974 Aug 24 15:41:11.876429 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 225/455] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:11 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:11.878845 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-096652df-2244-4b84-81c9-a8d16640db6a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.227497 Aug 24 15:41:11.879411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 231/456] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:11 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:11.981250 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:11.981862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:11.987894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:11.988537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:11.988979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:11.989726 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:11.990182 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:11.990609 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:12.124561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:12.133667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-88a2dfd2-7024-44b1-8111-f0ea4c610629 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.156286 Aug 24 15:41:12.134280 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 226/457] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:11 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:12.896630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:12.897201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:12.899516 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:12.900128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:12.903662 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:12.904154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:12.904590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:12.905293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:12.905751 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:12.906179 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:12.906492 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:12.906990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:12.907422 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:12.908105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:12.908559 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:12.908979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:13.105751 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:13.113060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:13.113581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2d247a4c-b1b3-4e8f-bac1-01b2e2d6e12e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1366 microversion: 2.1 time: 0.221485 Aug 24 15:41:13.114116 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 232/458] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:12 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:13.121351 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3e6fa6fe-ea2d-4d8c-b5e0-b3537c15cb9d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.225585 Aug 24 15:41:13.121984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 227/459] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:12 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:13.155832 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:13.156429 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:13.162552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:13.163063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:13.163489 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:13.164170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:13.164620 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:13.165042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:13.293249 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:13.301541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-372d7edc-ec54-4a8d-8220-169d4bcc6d7f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.149584 Aug 24 15:41:13.302101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 233/460] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:13 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:13.761410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-825cdb22-5263-43ac-bec8-41ddcf2a5fde req-8b6f6b67-cda6-4cc6-b81d-655f99f5a697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b", "name": "network-vif-plugged", "status": "completed", "tag": "b97df505-95e6-44e6-b833-4fc18dc0cdf2"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:13.771654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-825cdb22-5263-43ac-bec8-41ddcf2a5fde req-8b6f6b67-cda6-4cc6-b81d-655f99f5a697 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:13.772133 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-825cdb22-5263-43ac-bec8-41ddcf2a5fde req-8b6f6b67-cda6-4cc6-b81d-655f99f5a697 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:13.772569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-825cdb22-5263-43ac-bec8-41ddcf2a5fde req-8b6f6b67-cda6-4cc6-b81d-655f99f5a697 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:13.784201 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-825cdb22-5263-43ac-bec8-41ddcf2a5fde req-8b6f6b67-cda6-4cc6-b81d-655f99f5a697 service nova] Creating event network-vif-plugged:b97df505-95e6-44e6-b833-4fc18dc0cdf2 for instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b on hv-cinder-84605 Aug 24 15:41:13.789594 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-825cdb22-5263-43ac-bec8-41ddcf2a5fde req-8b6f6b67-cda6-4cc6-b81d-655f99f5a697 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031840 Aug 24 15:41:13.790341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 228/461] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:14.134152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:14.134799 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:14.137212 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:14.142721 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:14.143282 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:14.143725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:14.143886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:14.145165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:14.145631 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:14.146057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:14.146276 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:14.148994 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:14.155424 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:14.155908 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:14.156339 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:14.157020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:14.157489 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:14.158080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:14.358526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:14.366023 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:14.367065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7b658887-2f76-4562-8b34-34ca7d69d24d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1366 microversion: 2.1 time: 0.236868 Aug 24 15:41:14.367684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 234/462] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:14 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:14.373738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-bdb6b1b8-baa4-480e-8b4d-6268127289ae tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.234035 Aug 24 15:41:14.374296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 229/463] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:14 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:14.376629 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:14.377295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:14.384250 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:14.384733 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:14.385166 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:14.385853 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:14.386304 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:14.386759 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:14.517457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:14.526240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5787e570-8873-4945-af81-eff20ba6792e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.153343 Aug 24 15:41:14.526777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 235/464] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:14 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:15.388456 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:15.388988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:15.394996 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:15.395465 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:15.395608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:15.395942 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:15.396372 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:15.397048 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:15.397498 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:15.397909 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:15.401913 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:15.402391 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:15.402865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:15.403552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:15.404025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:15.404430 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:15.615904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:15.617130 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:15.624164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d8f7c1f4-5ac4-4a3b-b45a-cbc7d58c1bf7 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.233191 Aug 24 15:41:15.624970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 236/465] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:15 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:15.629953 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:15.630568 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:15.638407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:15.638995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:15.639211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e2071037-77c9-41f3-8691-e16a623a734d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1366 microversion: 2.1 time: 0.254624 Aug 24 15:41:15.639423 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:15.639819 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 230/466] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:15 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:15.640132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:15.640591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:15.641022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:15.785533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:15.793890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-89c04a6c-4b9f-4569-9453-fa5840d98c9b tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.167740 Aug 24 15:41:15.794464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 237/467] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:15 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:15.815608 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-03b034ea-3885-47fb-8088-36afc7015ee2 req-a1dd276c-8782-4dc8-9f12-58a311f6d3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e2044-e4e4-493a-afc5-c7de2fe009e9", "name": "network-vif-plugged", "status": "completed", "tag": "66ef2e63-7ae1-45ca-bc1b-3eb35bd0a892"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:15.825183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-03b034ea-3885-47fb-8088-36afc7015ee2 req-a1dd276c-8782-4dc8-9f12-58a311f6d3a2 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:15.825654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-03b034ea-3885-47fb-8088-36afc7015ee2 req-a1dd276c-8782-4dc8-9f12-58a311f6d3a2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:15.826081 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-03b034ea-3885-47fb-8088-36afc7015ee2 req-a1dd276c-8782-4dc8-9f12-58a311f6d3a2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:15.837619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-03b034ea-3885-47fb-8088-36afc7015ee2 req-a1dd276c-8782-4dc8-9f12-58a311f6d3a2 service nova] Creating event network-vif-plugged:66ef2e63-7ae1-45ca-bc1b-3eb35bd0a892 for instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 on hv-cinder-84605 Aug 24 15:41:15.842456 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-03b034ea-3885-47fb-8088-36afc7015ee2 req-a1dd276c-8782-4dc8-9f12-58a311f6d3a2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030403 Aug 24 15:41:15.843077 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 231/468] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:16.645256 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:16.646253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:16.653903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.654840 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.656228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:16.656958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.657438 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.657865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:16.664670 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:16.665520 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:16.667978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=4 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:16.668688 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=12 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:16.684870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.685451 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.685846 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:16.686531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.687180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.687692 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:16.716633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=8 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:16.904012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:16.907134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:16.914126 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1968106b-ef00-4ea8-88c3-9656e652df14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.272672 Aug 24 15:41:16.914814 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 238/469] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:16 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:16.917243 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1902ae05-3c53-4c10-9388-f80f07a4d1f7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1556 microversion: 2.1 time: 0.259581 Aug 24 15:41:16.919637 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:16.920580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:16.927253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.927743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.928181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:16.928890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.929345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.929794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:16.931010 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 232/470] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:16 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1556 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:16.940514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:16.941023 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:16.946971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.947965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.948408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:16.949164 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:16.949769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:16.950190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:17.079122 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-91108a19-b111-4eee-9d00-3849850c0975 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142535 Aug 24 15:41:17.079731 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 233/471] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:41:16 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:17.134842 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:17.143279 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3b9fb44a-79b2-439a-8121-997c7d909505 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.227502 Aug 24 15:41:17.143882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 239/472] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:16 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:17.936996 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:17.937619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:17.946153 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:17.946914 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:17.947613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:17.948620 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:17.949305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:17.950026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:18.005010 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-a7afdacc-d31f-4042-8605-6374ecdad53b req-e08907aa-31cc-460e-89b8-5acf2d9eecd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b", "tag": "b97df505-95e6-44e6-b833-4fc18dc0cdf2"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:18.015067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-a7afdacc-d31f-4042-8605-6374ecdad53b req-e08907aa-31cc-460e-89b8-5acf2d9eecd7 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:18.015543 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-a7afdacc-d31f-4042-8605-6374ecdad53b req-e08907aa-31cc-460e-89b8-5acf2d9eecd7 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:18.015968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-a7afdacc-d31f-4042-8605-6374ecdad53b req-e08907aa-31cc-460e-89b8-5acf2d9eecd7 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:18.020702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=100 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:18.029534 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-a7afdacc-d31f-4042-8605-6374ecdad53b req-e08907aa-31cc-460e-89b8-5acf2d9eecd7 service nova] Creating event network-changed:b97df505-95e6-44e6-b833-4fc18dc0cdf2 for instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b on hv-cinder-84605 Aug 24 15:41:18.034587 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-a7afdacc-d31f-4042-8605-6374ecdad53b req-e08907aa-31cc-460e-89b8-5acf2d9eecd7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033218 Aug 24 15:41:18.035962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 240/473] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:18.103918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:18.111832 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b41c99c2-a0d4-466c-96b1-d2634d5f5553 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1319 microversion: 2.1 time: 0.179283 Aug 24 15:41:18.112542 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 234/474] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:17 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:18.165934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:18.166803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:18.172931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:18.173404 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:18.173835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:18.174526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:18.176098 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:18.176672 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:18.333613 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:18.344497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0092b77c-4f91-4db0-a927-ce41013efe33 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1734 microversion: 2.1 time: 0.182637 Aug 24 15:41:18.346417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 241/475] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:18 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:19.133286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:19.133906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:19.141011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.141507 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.141946 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.142681 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.143135 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.143560 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.277901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:19.287699 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1f1203b6-a4b6-4615-9655-583f911e2962 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1508 microversion: 2.1 time: 0.158382 Aug 24 15:41:19.288308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 235/476] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:19 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:19.369371 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:19.370047 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:19.377258 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.377743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.378180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.379035 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.379594 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.380019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.602700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:19.611966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-275a3f39-7b18-4fa6-9823-2caa0457114f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1714 microversion: 2.1 time: 0.246398 Aug 24 15:41:19.612544 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 242/477] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:19 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1714 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:19.754449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:19.755449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:19.762280 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.762762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.763195 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.763887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.764329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.764750 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.853710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] HTTP exception thrown: Cannot 'detach_volume' instance 8dd8a365-ce5e-405e-8b76-93303538f94e while it is in vm_state rescued Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Request method failure captured: Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: DELETE /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments/2c7bff9f-3c70-4bab-8672-9c24f67feab5 HTTP/1.1 Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5CZt0tAlR3mpFR4ggVXXsyZBdFuqvdWobkUmWkxTjTRtSDtWM9_GQyWYV6ysWKWS443Z7qgWdmOM3dWNy8gtlL03uN_kM2Q37BeuiXM6LlrsK3kP9qzaBe69YpoNR5Ru0sqJnrd5A2-7UiTCtqDB6WyTMwmEMfFY1vZEtgUhvYJk Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:41:19.855387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d204b26857042e397b91be285fa3ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d204b26857042e397b91be285fa3ed9"}]}] Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 4dd615d7af7741b08cc44b6c983fae49 Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:41:19.857614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Cannot 'detach_volume' instance 8dd8a365-ce5e-405e-8b76-93303538f94e while it is in vm_state rescued Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'server_id': '8dd8a365-ce5e-405e-8b76-93303538f94e', 'id': '2c7bff9f-3c70-4bab-8672-9c24f67feab5'} Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8dd8a365-ce5e-405e-8b76-93303538f94e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:41:19.858450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8dd8a365-ce5e-405e-8b76-93303538f94e while it is in vm_state rescued Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8dd8a365-ce5e-405e-8b76-93303538f94e while it is in vm_state rescued Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:41:19.859804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Returning 409 to user: Cannot 'detach_volume' instance 8dd8a365-ce5e-405e-8b76-93303538f94e while it is in vm_state rescued {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:41:19.860785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3c538f05-83fb-444b-99e0-262b32f422dd tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments/2c7bff9f-3c70-4bab-8672-9c24f67feab5" status: 409 len: 152 microversion: 2.1 time: 0.106508 Aug 24 15:41:19.860892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 236/478] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:41:19 2022] DELETE /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments/2c7bff9f-3c70-4bab-8672-9c24f67feab5 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:41:19.867211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:19.867745 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:19.875014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.875505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.875940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.876640 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.877291 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.877716 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.952723 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c445e909-04aa-4e68-9230-416114c26279 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "POST /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/action" status: 202 len: 0 microversion: 2.1 time: 0.089639 Aug 24 15:41:19.953591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 243/479] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:41:19 2022] POST /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:41:19.962989 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:19.963534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:19.970368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.971139 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.971576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:19.972295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:19.972883 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:19.973413 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:20.210562 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:20.219824 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-333b1e37-dec0-448e-adcd-d5e594b8cbbc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1722 microversion: 2.1 time: 0.260903 Aug 24 15:41:20.220396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 237/480] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:19 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:21.243501 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:21.244345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:21.251523 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:21.252019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:21.252454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:21.253156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:21.253644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:21.254589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:21.394731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:21.402857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d3c9e57f-0603-4b83-ae98-f86109e349ad tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1722 microversion: 2.1 time: 0.165492 Aug 24 15:41:21.403412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 244/481] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:21 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:22.424391 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:22.425004 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:22.432048 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:22.432525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:22.432959 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:22.433641 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:22.434090 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:22.434510 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:22.566658 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:22.571720 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=100 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:22.578272 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ad395e4b-38bc-4c07-9c3c-dac67ae4ea0f tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1722 microversion: 2.1 time: 0.157748 Aug 24 15:41:22.578821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 238/482] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:22 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:23.584167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:23.586326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:23.592822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.593301 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.593735 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:23.594417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.594898 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.595317 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:23.600150 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:23.600775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:23.607394 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.607878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.608440 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:23.609128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.609582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.610006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:23.669866 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-94ba0575-96bc-4a34-99f8-7576f9d156b0 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/action" status: 202 len: 0 microversion: 2.1 time: 0.089796 Aug 24 15:41:23.670507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 245/483] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:41:23 2022] POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:41:23.680497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:23.681701 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:23.690873 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.691336 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.695369 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:23.696681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.697442 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.698066 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:23.833622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:23.842604 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e5223381-fc57-4a25-a118-3a711b298dbf tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1728 microversion: 2.1 time: 0.246680 Aug 24 15:41:23.843093 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 239/484] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:23 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:23.863631 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:23.864111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:23.870790 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.871277 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.871714 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:23.872409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:23.872862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:23.873283 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:24.004618 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:24.012944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-736c84d5-7e1e-4d8e-ba85-b097082e523f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1751 microversion: 2.1 time: 0.338109 Aug 24 15:41:24.013503 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 246/485] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:23 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1751 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:24.018687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f27ee325-eb69-4f38-853e-315cb1b2bc5d tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158766 Aug 24 15:41:24.020124 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 240/486] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:41:23 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:25.035503 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:25.036150 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:25.045717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:25.046199 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:25.046625 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:25.047514 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:25.047967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:25.048391 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:25.315109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:25.323998 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ab921c25-1458-4fc6-a0d1-2dd7ca1e7dc5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1751 microversion: 2.1 time: 0.292753 Aug 24 15:41:25.324641 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 247/487] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:25 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1751 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:25.575206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-ae859062-2064-48d7-a985-3c2c6e895724 req-71d778f4-51ce-46db-8462-a3ae0a38096c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd8a365-ce5e-405e-8b76-93303538f94e", "tag": "d30bf2eb-be05-4025-9994-339e033189d7"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:25.585476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-ae859062-2064-48d7-a985-3c2c6e895724 req-71d778f4-51ce-46db-8462-a3ae0a38096c service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:25.586102 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-ae859062-2064-48d7-a985-3c2c6e895724 req-71d778f4-51ce-46db-8462-a3ae0a38096c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:25.586531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-ae859062-2064-48d7-a985-3c2c6e895724 req-71d778f4-51ce-46db-8462-a3ae0a38096c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:25.598815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-ae859062-2064-48d7-a985-3c2c6e895724 req-71d778f4-51ce-46db-8462-a3ae0a38096c service nova] Creating event network-changed:d30bf2eb-be05-4025-9994-339e033189d7 for instance 8dd8a365-ce5e-405e-8b76-93303538f94e on hv-cinder-84605 Aug 24 15:41:25.607070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-ae859062-2064-48d7-a985-3c2c6e895724 req-71d778f4-51ce-46db-8462-a3ae0a38096c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036146 Aug 24 15:41:25.607759 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 241/488] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:26.345810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:26.346425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:26.358009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:26.358500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:26.358958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:26.360097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:26.360577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:26.361009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:26.534284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:26.543562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5100c597-38db-4b0f-8150-2246c90dbf24 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.201967 Aug 24 15:41:26.544134 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 248/489] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:26 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:27.565876 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:27.566754 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:27.573948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:27.574426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:27.574892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:27.575580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:27.576033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:27.576457 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:27.627778 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-411fb72a-f58d-45f8-8758-564a09fb2174 req-c4da4c15-7999-4c50-8931-c997c67724df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd8a365-ce5e-405e-8b76-93303538f94e", "tag": "d30bf2eb-be05-4025-9994-339e033189d7"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:27.638260 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-411fb72a-f58d-45f8-8758-564a09fb2174 req-c4da4c15-7999-4c50-8931-c997c67724df service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:27.638762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-411fb72a-f58d-45f8-8758-564a09fb2174 req-c4da4c15-7999-4c50-8931-c997c67724df service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:27.639186 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-411fb72a-f58d-45f8-8758-564a09fb2174 req-c4da4c15-7999-4c50-8931-c997c67724df service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:27.650738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-411fb72a-f58d-45f8-8758-564a09fb2174 req-c4da4c15-7999-4c50-8931-c997c67724df service nova] Creating event network-changed:d30bf2eb-be05-4025-9994-339e033189d7 for instance 8dd8a365-ce5e-405e-8b76-93303538f94e on hv-cinder-84605 Aug 24 15:41:27.655601 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-411fb72a-f58d-45f8-8758-564a09fb2174 req-c4da4c15-7999-4c50-8931-c997c67724df service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031459 Aug 24 15:41:27.656217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 249/490] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:27.733185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:27.742005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e0a7b5c5-4ea0-46d9-89c8-ae23d71807b2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.180394 Aug 24 15:41:27.742566 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 242/491] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:27 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:28.764960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:28.765699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:28.773120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:28.773641 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:28.774106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:28.774915 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:28.775371 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:28.775789 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:28.919196 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:28.929232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-655dca27-ee02-4ad1-8e13-2ba784d711ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.168977 Aug 24 15:41:28.929821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 250/492] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:28 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:29.950587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:29.951212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:29.958021 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:29.959230 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:29.959675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:29.960380 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:29.960842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:29.961281 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:30.120667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:30.128960 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c114b5ea-df07-4648-9082-6832625fe38c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.182230 Aug 24 15:41:30.129532 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 243/493] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:29 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:31.152075 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:31.152686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:31.159248 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.159723 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.160156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.160857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.161315 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.161720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.246231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:31.248516 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:31.254955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.255961 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.256399 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.257101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.257578 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.257988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.290539 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-afdb8fa1-556d-4fdd-85b0-002ef4948cc7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048171 Aug 24 15:41:31.296369 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 244/494] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:41:31 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:41:31.315939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:31.328410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-40ef3833-8d59-4142-8687-5be669bb5c63 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.180134 Aug 24 15:41:31.329283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 251/495] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:31 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:31.369857 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:31.370353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:31.376365 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.376845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.377278 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.377964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.378415 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.378886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.404374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:41:31.484446 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8a0ec890-c71f-4861-bcf1-79444689eacc tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 204 len: 0 microversion: 2.1 time: 0.118039 Aug 24 15:41:31.484947 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 245/496] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:41:31 2022] DELETE /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:41:31.494059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:31.494994 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:31.500890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.501375 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.501810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.502502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:31.502991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:31.503423 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:31.636650 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:31.644327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-13af2271-d144-4b42-b5f7-cd4603e66a15 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1672 microversion: 2.1 time: 0.155057 Aug 24 15:41:31.644891 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 252/497] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:31 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:32.352497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:32.353481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:32.359926 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:32.360405 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:32.360842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:32.361533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:32.361989 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:32.362417 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:32.507386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:32.515679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a4069150-49ec-42d0-8694-6ebc3dd12587 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.168199 Aug 24 15:41:32.516249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 246/498] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:32 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:32.665810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:32.666500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:32.672985 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:32.673460 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:32.673890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:32.674569 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:32.675047 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:32.675467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:32.814055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:32.822215 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-14068d7c-b567-4096-ad96-4097d1e9623b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1672 microversion: 2.1 time: 0.160776 Aug 24 15:41:32.822810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 253/499] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:32 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:33.538080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:33.538712 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:33.545105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:33.545589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:33.546021 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:33.546734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:33.547188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:33.547619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:33.692409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:33.700680 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3b3ab2a9-3773-4552-bc89-0a00f5984a79 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.167157 Aug 24 15:41:33.701240 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 247/500] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:33 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:33.844607 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:33.845217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:33.852475 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:33.853216 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:33.853652 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:33.854339 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:33.854827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:33.855253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:33.992357 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:34.000838 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1b71c3d2-da65-4866-bbb7-908425ed48d0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1672 microversion: 2.1 time: 0.160094 Aug 24 15:41:34.001407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 254/501] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:33 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:34.722103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:34.723045 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:34.729766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:34.730250 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:34.730720 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:34.731444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:34.731895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:34.732321 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:34.883771 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:34.892220 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-07ca52e9-dd7e-4663-a290-f6abae411b70 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.174630 Aug 24 15:41:34.892804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 248/502] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:34 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:34.925083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-33a22c9d-68b8-4726-9fbf-b03a7e7dfada req-55693039-bacf-4a5d-8b0a-38fd78dc46be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905f49ec-5f2b-4a83-994b-8d36385a9996", "name": "network-vif-deleted", "tag": "e556ad45-52e0-45b1-a43b-9779f17bd048"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:34.943217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-33a22c9d-68b8-4726-9fbf-b03a7e7dfada req-55693039-bacf-4a5d-8b0a-38fd78dc46be service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:34.943852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-33a22c9d-68b8-4726-9fbf-b03a7e7dfada req-55693039-bacf-4a5d-8b0a-38fd78dc46be service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:34.944561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-33a22c9d-68b8-4726-9fbf-b03a7e7dfada req-55693039-bacf-4a5d-8b0a-38fd78dc46be service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:34.958782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-33a22c9d-68b8-4726-9fbf-b03a7e7dfada req-55693039-bacf-4a5d-8b0a-38fd78dc46be service nova] Creating event network-vif-deleted:e556ad45-52e0-45b1-a43b-9779f17bd048 for instance 905f49ec-5f2b-4a83-994b-8d36385a9996 on hv-cinder-84605 Aug 24 15:41:34.965044 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-33a22c9d-68b8-4726-9fbf-b03a7e7dfada req-55693039-bacf-4a5d-8b0a-38fd78dc46be service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043540 Aug 24 15:41:34.965865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 255/503] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:35.024080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:35.024944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:35.033455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:35.034672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:35.035354 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:35.036319 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:35.037593 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:35.038580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:35.078611 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:35.079308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:35.079879 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:35.080468 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lazy-loading 'fault' on Instance uuid 905f49ec-5f2b-4a83-994b-8d36385a9996 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:41:35.128231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:35.137163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-11d0aee5-2dd3-4b3b-bbca-ad9ee2d43c9a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 200 len: 1327 microversion: 2.1 time: 0.118402 Aug 24 15:41:35.138049 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 249/504] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:35 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:35.589609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7023d24-cdaf-46ac-b446-13d2d6dc837a", "device": "/dev/sdb"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:35.592539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:35.598855 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:35.599334 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:35.599760 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:35.600445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:35.601419 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:35.601877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:35.682151 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:35.869236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-173b7cc2-5a78-4418-a7c6-b3bc9397f2f6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "POST /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283969 Aug 24 15:41:35.869787 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 256/505] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:41:35 2022] POST /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:35.914053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:35.914692 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:35.924620 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:35.926006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:35.926006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:35.926461 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:35.927104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:35.927683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:36.092705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:36.104679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-041ab51f-a26b-438f-bc44-80ce18ee45cc tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.194717 Aug 24 15:41:36.105274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 250/506] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:35 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:36.159993 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:36.160719 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:36.167550 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:36.168022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:36.168446 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:36.169122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:36.169566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:36.169981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:36.183085 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] HTTP exception thrown: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Request method failure captured: Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 HTTP/1.1 Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW2XSzmsRO_ta9JvEa5KW3vpaXuNJQT6m2Awg5TEAu9oNyPXTETBq5iR1b8k4cC8Qmezzvyn1cAuzI1iSe6TdhsNkhIo7q4yqa2lviJVA3aOuHgrSQTHyRDz-prVxSLnUU9bWUYzZWbypMEjJbRACvYynwkYDu-66y-xwHiWUF4kl8 Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:41:36.184661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98f176b3cafe45d497dee2f1d031a4ec", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98f176b3cafe45d497dee2f1d031a4ec"}]}] Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: f28236459bb9492eaa35690f121d4e3c Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:41:36.186180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '905f49ec-5f2b-4a83-994b-8d36385a9996'} Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:41:36.187055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:41:36.188463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:41:36.189727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Returning 404 to user: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:41:36.189727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-313575c4-3c56-4cf8-90bb-178275fd7010 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 404 len: 111 microversion: 2.1 time: 0.030804 Aug 24 15:41:36.189727 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 257/507] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:36 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:41:36.195141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a8c8912d-854e-405e-bbfb-434556da767e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '.version_select at 0x7f07834ed790>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:36.214734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a8c8912d-854e-405e-bbfb-434556da767e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438778067" status: 202 len: 0 microversion: 2.1 time: 0.023637 Aug 24 15:41:36.215425 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 251/508] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 15:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438778067 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:41:36.848084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b5001cfa-1a6b-49ba-a4fb-a5c8380b496e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'create', calling method: .version_select at 0x7f079084ba60>, body: {"keypair": {"name": "tempest-keypair-2025421860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgQHmiMuPbOzOe2UPuRBTW8EXCFTz9MSP+OPy73b36w0fiDlh39djuCfmdeWCtHMyDgQSSPrrkK2MYldlmZtmqKrr8o39tPHVHbUI9s6Ll9B+8YwVmMRZrORYGvqHX6jg=="}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:36.864029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-b5001cfa-1a6b-49ba-a4fb-a5c8380b496e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:41:36.868485 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-b5001cfa-1a6b-49ba-a4fb-a5c8380b496e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for user f28236459bb9492eaa35690f121d4e3c and project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:41:36.890709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b5001cfa-1a6b-49ba-a4fb-a5c8380b496e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046547 Aug 24 15:41:36.891299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 258/509] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:41:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:37.127032 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:37.127568 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:37.134840 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:37.135473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:37.135984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:37.136673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:37.137175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:37.137543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:37.286881 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:37.297887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5634d3d8-9cd5-4554-90ce-288218d20d2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.175938 Aug 24 15:41:37.312073 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 252/510] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:37 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:38.172562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-904068442", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4edf337-5391-4629-bda7-d1122fcdfc2b"}], "security_groups": [{"name": "tempest-securitygroup--1609220283"}], "key_name": "tempest-keypair-2025421860", "user_data": "}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:38.276734 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] validate_networks() for [('a4edf337-5391-4629-bda7-d1122fcdfc2b', None, None, None, None, None)] {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:41:38.319466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:38.320106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:38.327543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:38.328098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:38.328538 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:38.329287 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:38.329741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:38.330165 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:38.542227 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:38.550810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d968d979-a809-4f73-bb56-c29a3e609d6c tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.235226 Aug 24 15:41:38.551396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 253/511] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:38 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:38.722295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:41:38.722951 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:41:38.723428 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:41:38.723838 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:41:38.724297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:41:38.734850 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:38.735336 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:38.735766 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:38.736488 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:38.736938 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:38.737359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:38.755224 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:41:38.759282 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Getting quotas for user f28236459bb9492eaa35690f121d4e3c and project 98f176b3cafe45d497dee2f1d031a4ec. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:41:38.770138 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:41:38.772465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:41:38.819745 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-828b4300-f19e-41c1-aff7-2e4abf70d98f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.651769 Aug 24 15:41:38.820313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 259/512] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:41:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:41:38.831859 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6e181aa4-926e-429c-aff0-1a665174010c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:38.832464 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6e181aa4-926e-429c-aff0-1a665174010c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:38.890332 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6e181aa4-926e-429c-aff0-1a665174010c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:38.897313 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6e181aa4-926e-429c-aff0-1a665174010c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1237 microversion: 2.1 time: 0.069403 Aug 24 15:41:38.898578 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 254/513] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:38 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:39.572457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:39.573176 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:39.579483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:39.579904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:39.580343 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:39.581037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:39.581491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:39.581914 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:39.728162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:39.736534 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-eb35737b-1f06-4423-84d5-536d0e8521ff tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.168105 Aug 24 15:41:39.737096 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 260/514] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:39 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:39.920953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:39.920953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:39.938790 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:39.939386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:39.939895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:39.940672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:39.941200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:39.941802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:40.010265 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:40.018248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9f6aba56-542d-4299-a3f7-9facc8d6be2f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1297 microversion: 2.1 time: 0.103176 Aug 24 15:41:40.018830 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 255/515] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:39 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:40.757795 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:40.758486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:40.764944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:40.765359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:40.765785 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:40.766464 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:40.766941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:40.767360 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:40.916922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:40.926255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c5843d17-4a1a-4f4f-9fde-8200d74cbdd3 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1756 microversion: 2.1 time: 0.172833 Aug 24 15:41:40.926861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 261/516] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:40 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:41.040785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:41.041531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:41.048586 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:41.049156 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:41.049670 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:41.050524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:41.051178 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:41.051681 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:41.071841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:41.197622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:41.205665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0e6f303b-cc62-40f5-821a-52501f83bc38 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.169496 Aug 24 15:41:41.206292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 256/517] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:41 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:41.277284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-af5eaf9a-938a-4ec4-9609-c1b23655542b req-98c803dd-83c1-4232-8f25-9d9acc71ae49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d2a085-4e03-4b66-9095-5c934d177719", "tag": "0c3944b5-6421-49fd-b1b0-a42f4ca0afa6"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:41.286933 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-af5eaf9a-938a-4ec4-9609-c1b23655542b req-98c803dd-83c1-4232-8f25-9d9acc71ae49 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:41.287353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-af5eaf9a-938a-4ec4-9609-c1b23655542b req-98c803dd-83c1-4232-8f25-9d9acc71ae49 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:41.287960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-af5eaf9a-938a-4ec4-9609-c1b23655542b req-98c803dd-83c1-4232-8f25-9d9acc71ae49 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:41.299906 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-af5eaf9a-938a-4ec4-9609-c1b23655542b req-98c803dd-83c1-4232-8f25-9d9acc71ae49 service nova] Creating event network-changed:0c3944b5-6421-49fd-b1b0-a42f4ca0afa6 for instance c8d2a085-4e03-4b66-9095-5c934d177719 on hv-cinder-84605 Aug 24 15:41:41.305378 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-af5eaf9a-938a-4ec4-9609-c1b23655542b req-98c803dd-83c1-4232-8f25-9d9acc71ae49 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031829 Aug 24 15:41:41.305978 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 262/518] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:41.949183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:41.949959 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:41.956549 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:41.957076 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:41.957491 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:41.958192 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:41.958629 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:41.959073 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:42.120102 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:42.128262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-43cf45ab-f789-4155-a5d9-f24615b8ae69 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1759 microversion: 2.1 time: 0.183997 Aug 24 15:41:42.129216 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 257/519] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:41 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:42.229564 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:42.230191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:42.236241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:42.236713 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:42.237138 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:42.237812 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:42.238257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:42.238693 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:42.373611 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:42.381249 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f27309f6-98ce-4011-a246-fa54135049a3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.157315 Aug 24 15:41:42.381826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 263/520] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:42 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:43.405447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:43.406244 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:43.412718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:43.413375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:43.417496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:43.417496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:43.417496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:43.417496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:43.569202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:43.579880 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e5e119e6-e8bb-43f5-98b9-270bc42924d3 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.179873 Aug 24 15:41:43.580398 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 258/521] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:43 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:44.600491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:44.601651 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:44.604273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:44.609931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:44.610415 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:44.610876 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:44.611565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:44.612009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:44.612428 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:44.749018 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:44.756767 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7fcce0ea-85d4-4e0e-8488-f5fe2415e93a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.160278 Aug 24 15:41:44.757390 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 264/522] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:44 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:45.778571 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:45.779203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:45.781550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:45.787771 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:45.788981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:45.789599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:45.790457 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:45.790930 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:45.791353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:45.924856 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:45.933895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-59ddfe58-4985-4aa4-a4f6-f92c08956060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.159575 Aug 24 15:41:45.934463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 259/523] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:45 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:46.957589 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:46.958214 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:46.965150 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:46.965630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:46.966060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:46.966776 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:46.967222 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:46.967703 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:47.113530 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:47.121434 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-de124998-e1b2-48dc-aafb-862c5a2e008b tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.169178 Aug 24 15:41:47.121936 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 265/524] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:46 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:48.143552 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:48.144172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:48.151729 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:48.152231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:48.152673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:48.153663 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:48.155569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:48.155957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:48.178364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-fd4fbfd6-42e7-4c1f-ac6a-2e81572167fe req-30a00ddf-c5ea-44d2-b177-c01e06449df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d2a085-4e03-4b66-9095-5c934d177719", "name": "network-vif-plugged", "status": "completed", "tag": "0c3944b5-6421-49fd-b1b0-a42f4ca0afa6"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:48.203112 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fd4fbfd6-42e7-4c1f-ac6a-2e81572167fe req-30a00ddf-c5ea-44d2-b177-c01e06449df2 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:48.203688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fd4fbfd6-42e7-4c1f-ac6a-2e81572167fe req-30a00ddf-c5ea-44d2-b177-c01e06449df2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:48.204209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fd4fbfd6-42e7-4c1f-ac6a-2e81572167fe req-30a00ddf-c5ea-44d2-b177-c01e06449df2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:48.220127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-fd4fbfd6-42e7-4c1f-ac6a-2e81572167fe req-30a00ddf-c5ea-44d2-b177-c01e06449df2 service nova] Creating event network-vif-plugged:0c3944b5-6421-49fd-b1b0-a42f4ca0afa6 for instance c8d2a085-4e03-4b66-9095-5c934d177719 on hv-cinder-84605 Aug 24 15:41:48.227927 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-fd4fbfd6-42e7-4c1f-ac6a-2e81572167fe req-30a00ddf-c5ea-44d2-b177-c01e06449df2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054891 Aug 24 15:41:48.229330 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 266/525] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:41:48.326014 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:48.333975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fc87625d-2874-4749-9414-78c4f660b288 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.194650 Aug 24 15:41:48.334557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 260/526] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:48 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:49.355347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:49.356101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=10 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:49.360794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:49.361486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:49.369889 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:49.370546 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:49.371185 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:49.371870 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:49.372320 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:49.372737 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:49.510823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:49.520884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ca1e6532-0362-44e9-85dc-8adef37ef940 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.166750 Aug 24 15:41:49.521449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 267/527] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:49 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:50.544588 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:50.545374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:50.547228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:50.552952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:50.553423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:50.553848 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:50.554990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:50.555368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:50.555653 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:50.698365 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:50.706121 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a46d1512-d2dd-4628-bff7-58489f084b8f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.165490 Aug 24 15:41:50.706749 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 261/528] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:50 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:51.728414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:51.729210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:51.736318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:51.736994 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:51.737542 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:51.738476 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:51.738963 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:51.739392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:51.871676 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:51.879762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-327c81c4-4499-4b6a-878c-1ef5bdbdb820 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.155881 Aug 24 15:41:51.880334 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 268/529] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:51 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:52.901820 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:52.902366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:52.908788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:52.909269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:52.909705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:52.910387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:52.910881 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:52.911304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:53.039949 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:53.047458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-31088162-44a6-4d0f-b0b8-285cb3083c8e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.149958 Aug 24 15:41:53.048031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 262/530] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:52 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:54.068112 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:54.068719 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:54.075916 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:54.076392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:54.076826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:54.077508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:54.077960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:54.078387 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:54.215626 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:54.223521 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f189a5ac-8794-48aa-a19b-7ebddd80f61d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.159245 Aug 24 15:41:54.227393 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 269/531] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:54 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:55.245257 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:55.245866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:55.252491 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:55.252975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:55.253412 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:55.254101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:55.254555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:55.255005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:55.393234 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:55.401658 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-dea4a166-42a8-45e0-bb40-4e57e0cd6f00 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1363 microversion: 2.1 time: 0.160211 Aug 24 15:41:55.402238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 263/532] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:55 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:56.422409 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:56.423045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:56.430062 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:56.431083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:56.431512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:56.432212 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:56.432679 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:56.433091 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:56.572788 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:56.580401 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-30ab5553-4ce3-47b7-822e-6731e390107f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1549 microversion: 2.1 time: 0.161959 Aug 24 15:41:56.580965 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 270/533] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:56 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:56.601711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:56.602837 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:56.609435 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:56.609913 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:56.610346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:56.611097 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:56.611550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:56.611968 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:56.694389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a9bd49a9-95ac-4313-9c9c-b8b4087ad9ce tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096550 Aug 24 15:41:56.695044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 264/534] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:41:56 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:57.867029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-ba48e117-2eba-44eb-97dc-c6015f3e483b req-aa4396f1-21ce-4e8b-91f2-9b092d19e32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d2a085-4e03-4b66-9095-5c934d177719", "tag": "0c3944b5-6421-49fd-b1b0-a42f4ca0afa6"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:57.877470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ba48e117-2eba-44eb-97dc-c6015f3e483b req-aa4396f1-21ce-4e8b-91f2-9b092d19e32e service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:57.878074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ba48e117-2eba-44eb-97dc-c6015f3e483b req-aa4396f1-21ce-4e8b-91f2-9b092d19e32e service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:57.878571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ba48e117-2eba-44eb-97dc-c6015f3e483b req-aa4396f1-21ce-4e8b-91f2-9b092d19e32e service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:57.889538 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-ba48e117-2eba-44eb-97dc-c6015f3e483b req-aa4396f1-21ce-4e8b-91f2-9b092d19e32e service nova] Creating event network-changed:0c3944b5-6421-49fd-b1b0-a42f4ca0afa6 for instance c8d2a085-4e03-4b66-9095-5c934d177719 on hv-cinder-84605 Aug 24 15:41:57.894428 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-ba48e117-2eba-44eb-97dc-c6015f3e483b req-aa4396f1-21ce-4e8b-91f2-9b092d19e32e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Aug 24 15:41:57.895343 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 271/535] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:41:59.759412 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:59.759906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:59.765843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:59.766326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:59.766797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:59.767493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:59.767946 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:59.768370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:59.848575 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lazy-loading 'services' on Instance uuid ab3e2044-e4e4-493a-afc5-c7de2fe009e9 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:41:59.919535 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4fd5cd87-251f-427f-8f1d-ce76d751ea5e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9/os-volume_attachments/d7023d24-cdaf-46ac-b446-13d2d6dc837a" status: 202 len: 0 microversion: 2.1 time: 0.164437 Aug 24 15:41:59.920126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 265/536] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:41:59 2022] DELETE /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9/os-volume_attachments/d7023d24-cdaf-46ac-b446-13d2d6dc837a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:01.046668 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:01.047275 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:01.053447 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:01.053926 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:01.054361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:01.055076 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:01.056320 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:01.056746 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:01.080965 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:01.157167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e6db21d1-c4fd-47a0-ac3d-7c135467281c tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 204 len: 0 microversion: 2.1 time: 0.115070 Aug 24 15:42:01.157939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 272/537] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:01 2022] DELETE /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:42:01.168085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:01.168794 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:01.175205 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:01.175689 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:01.176126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:01.176815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:01.177266 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:01.177689 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:01.312725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:01.320549 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8ccba577-0c5e-4bcc-b21e-0aa85ea46c94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1514 microversion: 2.1 time: 0.158298 Aug 24 15:42:01.321797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 266/538] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:01 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:02.342545 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:02.343279 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:02.349635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:02.350123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:02.350556 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:02.351277 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:02.351731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:02.352159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:02.486671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:02.495043 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-da59968e-85b2-438d-8b8e-53f155b2d22b tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1514 microversion: 2.1 time: 0.156765 Aug 24 15:42:02.495608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 273/539] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:02 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:03.515520 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:03.516141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:03.527473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:03.527969 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:03.528408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:03.529117 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:03.529581 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:03.530000 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:03.570810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-7b5918fb-da12-454e-98c0-faff537de421 req-b3214e78-7ae4-4387-928e-3f87d72700d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3e2044-e4e4-493a-afc5-c7de2fe009e9", "name": "network-vif-deleted", "tag": "66ef2e63-7ae1-45ca-bc1b-3eb35bd0a892"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:03.582577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-7b5918fb-da12-454e-98c0-faff537de421 req-b3214e78-7ae4-4387-928e-3f87d72700d0 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:03.583081 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-7b5918fb-da12-454e-98c0-faff537de421 req-b3214e78-7ae4-4387-928e-3f87d72700d0 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:03.583720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-7b5918fb-da12-454e-98c0-faff537de421 req-b3214e78-7ae4-4387-928e-3f87d72700d0 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:03.596854 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-7b5918fb-da12-454e-98c0-faff537de421 req-b3214e78-7ae4-4387-928e-3f87d72700d0 service nova] Creating event network-vif-deleted:66ef2e63-7ae1-45ca-bc1b-3eb35bd0a892 for instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 on hv-cinder-84605 Aug 24 15:42:03.601973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:03.602277 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-7b5918fb-da12-454e-98c0-faff537de421 req-b3214e78-7ae4-4387-928e-3f87d72700d0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035091 Aug 24 15:42:03.602903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 274/540] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:03.611671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7cfd272c-93e7-4819-bb10-65a5856b8110 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 200 len: 1472 microversion: 2.1 time: 0.099912 Aug 24 15:42:03.612251 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 267/541] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:03 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 1472 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:04.634625 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:04.635380 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: ab3e2044-e4e4-493a-afc5-c7de2fe009e9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:04.642044 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:04.642606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:04.643227 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:04.643922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:04.644378 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:04.644804 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:04.657828 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] HTTP exception thrown: Instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 could not be found. Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Request method failure captured: Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 HTTP/1.1 Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkaPt2WmybeQXW6Eb-g1tWwmNCwei8246nao1CR0W80YEsTW1xZVrtVoRrxuV5UeZSNrrfymV3f0KsnOpRAf5knf4D06eEyXHLv33m3tA0_YtEgdwVJTcTBNJSG1GklmUVJviMuEu1XItumRl6tmjHrm1o4_wCo7nvFjPTRoXif3GY4 Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b578ad7d48e406fabfc32450de322d1 Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1246240646 Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:42:04.659457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b578ad7d48e406fabfc32450de322d1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b578ad7d48e406fabfc32450de322d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b578ad7d48e406fabfc32450de322d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b578ad7d48e406fabfc32450de322d1"}]}] Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesSnapshotTestJSON-1246240646 Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b578ad7d48e406fabfc32450de322d1 Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1246240646 Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesSnapshotTestJSON-1246240646-project Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 685fc311a8c14573b19719fb093e3ee2 Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesSnapshotTestJSON-1246240646-project Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 could not be found. Aug 24 15:42:04.661090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'ab3e2044-e4e4-493a-afc5-c7de2fe009e9'} Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 could not be found. Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:04.661949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 could not be found. Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 could not be found. Aug 24 15:42:04.663223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:04.664328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Returning 404 to user: Instance ab3e2044-e4e4-493a-afc5-c7de2fe009e9 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:04.664328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f8a9e705-cb03-4986-8f3c-11fbc6a0fa94 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9" status: 404 len: 111 microversion: 2.1 time: 0.031046 Aug 24 15:42:04.664328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 275/542] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:04 2022] GET /compute/v2.1/servers/ab3e2044-e4e4-493a-afc5-c7de2fe009e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:13.002751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:13.003299 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:13.009877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.010350 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.010821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.011503 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.011951 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.012369 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.014935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:13.094362 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lazy-loading 'services' on Instance uuid 8dd8a365-ce5e-405e-8b76-93303538f94e {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:13.166525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-492c0036-a66b-41d3-a88f-fb4ebcad1c18 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments/2c7bff9f-3c70-4bab-8672-9c24f67feab5" status: 202 len: 0 microversion: 2.1 time: 0.167595 Aug 24 15:42:13.167058 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 268/543] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:42:12 2022] DELETE /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments/2c7bff9f-3c70-4bab-8672-9c24f67feab5 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:13.175668 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:13.178087 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:13.184852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.185345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.185813 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.186491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.187027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.187425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.191368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:13.219869 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-747bed44-71ce-420a-a352-a61116c8f6d9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047875 Aug 24 15:42:13.220276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 276/544] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:13 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:13.488449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1174402076", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "networks": [{"uuid": "16e26aa1-fc84-40ef-9164-bff00905970c"}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:13.701199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] validate_networks() for [('16e26aa1-fc84-40ef-9164-bff00905970c', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:42:14.051417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:14.052023 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:14.058617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.059278 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.059723 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.061660 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.062322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.063009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.071973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:42:14.072956 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:42:14.073513 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:42:14.074974 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:42:14.075513 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:42:14.084773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.085246 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.085674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.086385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.086856 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.087919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.089326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4364b3dc-6ec8-49a0-8a2b-4dc08e6e9b88 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/ips" status: 200 len: 150 microversion: 2.1 time: 0.041874 Aug 24 15:42:14.089903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 277/545] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:42:14 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:14.104690 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Getting quotas for project 0b578ad7d48e406fabfc32450de322d1. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:42:14.109104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Getting quotas for user 685fc311a8c14573b19719fb093e3ee2 and project 0b578ad7d48e406fabfc32450de322d1. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:42:14.121564 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:42:14.124417 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:42:14.171905 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1d2e2a36-a9b3-43b3-be7d-994f56301ef5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687876 Aug 24 15:42:14.172708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 269/546] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:42:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:42:14.183910 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3b4cf932-61f7-49a8-bb06-ec6e389151dd tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:14.184712 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3b4cf932-61f7-49a8-bb06-ec6e389151dd tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:14.234446 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:14.239520 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:14.255319 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.255965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.256743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3b4cf932-61f7-49a8-bb06-ec6e389151dd tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:14.257375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.258322 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.259717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.260826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.265191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3b4cf932-61f7-49a8-bb06-ec6e389151dd tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1219 microversion: 2.1 time: 0.085298 Aug 24 15:42:14.265966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 278/547] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:14 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:14.313683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-14003bfd-99de-4d9b-81ea-3c36e830fce9 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085763 Aug 24 15:42:14.314491 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 270/548] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:14 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:42:14.402511 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:14.404160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:14.419253 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.419754 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.420192 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.421525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.421525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.422299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.456787 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:14.541123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ab9e90f4-fa6b-499c-8bcf-053d3508fcf0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 204 len: 0 microversion: 2.1 time: 0.142854 Aug 24 15:42:14.545011 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 279/549] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:14 2022] DELETE /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:42:14.551292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:14.552110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:14.559416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.560042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.560506 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.561282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.561743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.562167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.698286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:14.706001 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-614e2351-e56f-4ee3-b2e7-0cc9d2facb8e tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1688 microversion: 2.1 time: 0.159546 Aug 24 15:42:14.706567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 271/550] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:14 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:15.289861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:15.290591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:15.293012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:15.298109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:15.298590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:15.299042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:15.299719 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:15.300164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:15.300581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:15.365480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:15.373345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9746b53a-91ec-4c7e-bdde-d0bcc05f2e17 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1223 microversion: 2.1 time: 0.087673 Aug 24 15:42:15.373897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 280/551] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:15 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:15.516667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1db018b0-44b2-4fca-8cfc-00a548266272"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:15.519104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:15.525762 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:15.526770 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:15.527208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:15.527901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:15.528356 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:15.528780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:15.726834 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:15.727432 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:15.734112 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:15.734622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:15.735107 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:15.735820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:15.736267 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:15.736690 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:15.871652 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:15.879465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bc024250-7ac0-45ee-8783-a8e8f8dc21cc tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1688 microversion: 2.1 time: 0.156489 Aug 24 15:42:15.880037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 281/552] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:15 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:16.394690 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:16.395321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:16.402579 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:16.403086 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:16.403519 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:16.404206 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:16.404652 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:16.405091 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:16.471416 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:16.479600 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d9ad3072-9b35-4ef2-b7db-157efa64f386 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1223 microversion: 2.1 time: 0.088751 Aug 24 15:42:16.480136 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 282/553] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:16 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:16.901977 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:16.902515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:16.908803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:16.909284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:16.909710 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:16.910500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:16.911034 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:16.911453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:17.043605 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:17.051319 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1ed4af91-17a2-4a46-8362-dab5818191f0 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1688 microversion: 2.1 time: 0.153980 Aug 24 15:42:17.052648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 283/554] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:16 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:17.501084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:17.501735 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:17.508191 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:17.508672 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:17.509106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:17.510049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:17.510516 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:17.510985 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:17.627345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:17.635122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-70ca9ed5-34e3-4048-b34d-3f510f0919ad tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1223 microversion: 2.1 time: 0.137787 Aug 24 15:42:17.635687 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 284/555] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:17 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:18.072986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:18.073607 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:18.079610 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:18.080095 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:18.080525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:18.081235 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:18.081688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:18.082115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:18.209333 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:18.216934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f66cd9a6-fb75-4682-9611-de692d842c61 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1688 microversion: 2.1 time: 0.147896 Aug 24 15:42:18.217488 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 285/556] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:18 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:18.420341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5bc1c893-65f6-4bad-b003-4bc7ed79de26 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.907171 Aug 24 15:42:18.421133 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 272/557] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:42:15 2022] POST /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments => generated 194 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:18.655453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:18.656060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:18.663424 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:18.663903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:18.664331 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:18.665015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:18.665467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:18.666627 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:18.727346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:18.735792 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8229fa62-af68-4ea4-9db4-5b8ccece9e3f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1271 microversion: 2.1 time: 0.084412 Aug 24 15:42:18.736348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 286/558] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:18 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:19.239474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:19.240097 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:19.246148 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:19.248517 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:19.249467 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:19.250105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:19.251069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:19.252563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:19.253901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:19.490008 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:19.499293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8bf74d5c-2058-4935-ab24-de98032d5b53 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 200 len: 1688 microversion: 2.1 time: 0.264274 Aug 24 15:42:19.513848 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 273/559] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:19 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 1688 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:19.756137 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:19.756901 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:19.763696 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:19.764265 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:19.764782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:19.765486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:19.766176 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:19.766682 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:19.834439 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-792c56d6-5537-4bae-ac7c-d4c5798cf668 req-85a3245a-ecc8-4097-bdb9-ae24a209bc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd8a365-ce5e-405e-8b76-93303538f94e", "name": "network-vif-deleted", "tag": "d30bf2eb-be05-4025-9994-339e033189d7"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:19.844885 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-792c56d6-5537-4bae-ac7c-d4c5798cf668 req-85a3245a-ecc8-4097-bdb9-ae24a209bc53 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:19.845354 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-792c56d6-5537-4bae-ac7c-d4c5798cf668 req-85a3245a-ecc8-4097-bdb9-ae24a209bc53 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:19.845782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-792c56d6-5537-4bae-ac7c-d4c5798cf668 req-85a3245a-ecc8-4097-bdb9-ae24a209bc53 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:19.858161 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-792c56d6-5537-4bae-ac7c-d4c5798cf668 req-85a3245a-ecc8-4097-bdb9-ae24a209bc53 service nova] Creating event network-vif-deleted:d30bf2eb-be05-4025-9994-339e033189d7 for instance 8dd8a365-ce5e-405e-8b76-93303538f94e on hv-cinder-84605 Aug 24 15:42:19.864682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-792c56d6-5537-4bae-ac7c-d4c5798cf668 req-85a3245a-ecc8-4097-bdb9-ae24a209bc53 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033785 Aug 24 15:42:19.868602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 274/560] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:20.048599 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:20.058669 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-21f29309-8f47-4fbe-80b9-a2f89acc2b71 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1319 microversion: 2.1 time: 0.306069 Aug 24 15:42:20.072688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 287/561] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:19 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:20.522383 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:20.523264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: 8dd8a365-ce5e-405e-8b76-93303538f94e] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:20.531659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:20.532174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:20.532613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:20.533388 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:20.533785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:20.535234 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:20.549952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] HTTP exception thrown: Instance 8dd8a365-ce5e-405e-8b76-93303538f94e could not be found. Aug 24 15:42:20.559707 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-2303712c-1c2d-4440-b5c0-631367afc55b req-93f3db49-1372-4fc7-a3b3-6723308f0d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c368641-febc-420a-926d-929cb66d0ec6", "tag": "66e33da5-8c21-43f1-8547-a5e3f65a9a42"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:20.569793 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-2303712c-1c2d-4440-b5c0-631367afc55b req-93f3db49-1372-4fc7-a3b3-6723308f0d20 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:20.573098 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-2303712c-1c2d-4440-b5c0-631367afc55b req-93f3db49-1372-4fc7-a3b3-6723308f0d20 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:20.573098 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-2303712c-1c2d-4440-b5c0-631367afc55b req-93f3db49-1372-4fc7-a3b3-6723308f0d20 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Request method failure captured: Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e HTTP/1.1 Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5CZt0tAlR3mpFR4ggVXXsyZBdFuqvdWobkUmWkxTjTRtSDtWM9_GQyWYV6ysWKWS443Z7qgWdmOM3dWNy8gtlL03uN_kM2Q37BeuiXM6LlrsK3kP9qzaBe69YpoNR5Ru0sqJnrd5A2-7UiTCtqDB6WyTMwmEMfFY1vZEtgUhvYJk Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:42:20.580872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d204b26857042e397b91be285fa3ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d204b26857042e397b91be285fa3ed9"}]}] Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 4dd615d7af7741b08cc44b6c983fae49 Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 8dd8a365-ce5e-405e-8b76-93303538f94e could not be found. Aug 24 15:42:20.582486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '8dd8a365-ce5e-405e-8b76-93303538f94e'} Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd8a365-ce5e-405e-8b76-93303538f94e could not be found. Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:20.583536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd8a365-ce5e-405e-8b76-93303538f94e could not be found. Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd8a365-ce5e-405e-8b76-93303538f94e could not be found. Aug 24 15:42:20.585019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:20.588422 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Returning 404 to user: Instance 8dd8a365-ce5e-405e-8b76-93303538f94e could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:20.590473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a49e38b5-1618-46e5-b1da-8e70a9167b95 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e" status: 404 len: 111 microversion: 2.1 time: 0.073059 Aug 24 15:42:20.592275 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-2303712c-1c2d-4440-b5c0-631367afc55b req-93f3db49-1372-4fc7-a3b3-6723308f0d20 service nova] Creating event network-changed:66e33da5-8c21-43f1-8547-a5e3f65a9a42 for instance 5c368641-febc-420a-926d-929cb66d0ec6 on hv-cinder-84605 Aug 24 15:42:20.594844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 275/562] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:20 2022] GET /compute/v2.1/servers/8dd8a365-ce5e-405e-8b76-93303538f94e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:20.597907 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-2303712c-1c2d-4440-b5c0-631367afc55b req-93f3db49-1372-4fc7-a3b3-6723308f0d20 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043733 Aug 24 15:42:20.599142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 288/563] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:20.600173 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5d000c2b-4ae1-447f-befd-3f4670a9c46c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '.version_select at 0x7f078344e9d0>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:20.630842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5d000c2b-4ae1-447f-befd-3f4670a9c46c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505483707" status: 202 len: 0 microversion: 2.1 time: 0.034700 Aug 24 15:42:20.632883 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 276/564] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 15:42:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505483707 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:21.082347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:21.083094 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:21.091614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:21.092109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:21.092547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:21.093502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:21.093963 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:21.094390 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:21.239199 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:21.247767 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cb243adf-a7e7-459c-9009-7f5d50f7ef20 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1319 microversion: 2.1 time: 0.170008 Aug 24 15:42:21.248348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 289/565] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:21 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:22.270113 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:22.270769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:22.279403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:22.279892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:22.280331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:22.281038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:22.281497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:22.281922 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:22.498368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:22.507764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7bee63c5-2c92-4f59-8a87-cded06299dc6 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1319 microversion: 2.1 time: 0.242236 Aug 24 15:42:22.508342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 277/566] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:22 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:23.529920 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:23.530699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:23.537122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.537606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.538038 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.538750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.539207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.539636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.669112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:23.669639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:23.673944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:23.678420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.678931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.679361 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.680090 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.680541 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.680958 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.682299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b937308b-01ed-4256-a1ac-7da89b5907e2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1319 microversion: 2.1 time: 0.156865 Aug 24 15:42:23.683772 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 290/567] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:23 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:23.706396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:23.781619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c734e111-dfa9-4523-bada-899fde80f25c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "DELETE /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 204 len: 0 microversion: 2.1 time: 0.116279 Aug 24 15:42:23.782134 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 278/568] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:23 2022] DELETE /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:42:23.790328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:23.791140 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:23.797357 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.797846 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.798281 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.799002 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.799457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.799883 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.935214 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:23.943059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f1c7e33d-8831-4e11-a2f4-2868aa972c84 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1506 microversion: 2.1 time: 0.156636 Aug 24 15:42:23.943634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 291/569] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:23 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:24.704473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:24.705097 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:24.707026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:24.707673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:24.714778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:24.715915 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:24.716360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:24.717066 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:24.717519 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:24.717938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:24.848975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:24.858948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d41d7a27-661d-4f1f-b8c1-2820ea9cbd14 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1319 microversion: 2.1 time: 0.158652 Aug 24 15:42:24.859535 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 279/570] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:24 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:24.966012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:24.966529 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:24.968476 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:24.974134 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:24.974608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:24.975060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:24.975744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:24.976192 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:24.976609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:25.104008 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:25.111788 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-052a4ba8-cb34-4e5b-b5e5-bcc55c533dc4 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1506 microversion: 2.1 time: 0.150666 Aug 24 15:42:25.112359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 292/571] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:24 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:25.880029 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:25.880641 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:25.887078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:25.887560 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:25.888006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:25.888699 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:25.889156 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:25.889582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:26.033074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:26.041501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-df37a972-fdbe-4eec-9fa7-85be8ea3748f tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1319 microversion: 2.1 time: 0.164818 Aug 24 15:42:26.042065 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 280/572] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:25 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:26.132447 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:26.132982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:26.139483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:26.139967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:26.140402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:26.141093 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:26.141549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:26.141982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:26.144541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:26.273011 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:26.281835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-565409e3-a1d6-4a8d-b028-988e9f789eba tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1506 microversion: 2.1 time: 0.153241 Aug 24 15:42:26.289737 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 293/573] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:26 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:26.397741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-dddb7e0a-62c7-4d6d-8eda-2bbb61911af1 req-f596eef0-3914-459f-b47c-6fb83eae7c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c368641-febc-420a-926d-929cb66d0ec6", "name": "network-vif-plugged", "status": "completed", "tag": "66e33da5-8c21-43f1-8547-a5e3f65a9a42"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:26.408112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-dddb7e0a-62c7-4d6d-8eda-2bbb61911af1 req-f596eef0-3914-459f-b47c-6fb83eae7c2e service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:26.408653 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-dddb7e0a-62c7-4d6d-8eda-2bbb61911af1 req-f596eef0-3914-459f-b47c-6fb83eae7c2e service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:26.409144 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-dddb7e0a-62c7-4d6d-8eda-2bbb61911af1 req-f596eef0-3914-459f-b47c-6fb83eae7c2e service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:26.420959 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-dddb7e0a-62c7-4d6d-8eda-2bbb61911af1 req-f596eef0-3914-459f-b47c-6fb83eae7c2e service nova] Creating event network-vif-plugged:66e33da5-8c21-43f1-8547-a5e3f65a9a42 for instance 5c368641-febc-420a-926d-929cb66d0ec6 on hv-cinder-84605 Aug 24 15:42:26.425816 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-dddb7e0a-62c7-4d6d-8eda-2bbb61911af1 req-f596eef0-3914-459f-b47c-6fb83eae7c2e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 Aug 24 15:42:26.426406 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 281/574] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:27.062668 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:27.063460 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:27.069499 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.069963 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.070392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.071251 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.071706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.072175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.105360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1db018b0-44b2-4fca-8cfc-00a548266272"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:27.108153 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:27.115050 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.115545 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.115983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.116700 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.117155 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.117580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.202413 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Invalid volume: volume 1db018b0-44b2-4fca-8cfc-00a548266272 is already attached to instances: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: POST /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments HTTP/1.1 Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 74 Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:42:27.214805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {"volumeAttachment": {"volumeId": "1db018b0-44b2-4fca-8cfc-00a548266272"}} Aug 24 15:42:27.216295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Invalid volume: volume 1db018b0-44b2-4fca-8cfc-00a548266272 is already attached to instances: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'server_id': '1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b', 'body': {'volumeAttachment': {'volumeId': '1db018b0-44b2-4fca-8cfc-00a548266272'}}} Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1db018b0-44b2-4fca-8cfc-00a548266272 is already attached to instances: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:27.217270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1db018b0-44b2-4fca-8cfc-00a548266272 is already attached to instances: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:27.219020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1db018b0-44b2-4fca-8cfc-00a548266272 is already attached to instances: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 400 to user: Invalid volume: volume 1db018b0-44b2-4fca-8cfc-00a548266272 is already attached to instances: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-251b7bfe-9d11-466d-893f-9d4838dcfdcc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115996 Aug 24 15:42:27.220500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 282/575] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:42:27 2022] POST /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 15:42:27.286286 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:27.286826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:27.294003 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.294488 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.294960 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.295649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.296199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.296622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.386085 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lazy-loading 'services' on Instance uuid 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:27.459470 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d51af1df-5016-474f-b6c7-8f216b08ff3f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments/1db018b0-44b2-4fca-8cfc-00a548266272" status: 202 len: 0 microversion: 2.1 time: 0.176986 Aug 24 15:42:27.460055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 283/576] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:42:27 2022] DELETE /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments/1db018b0-44b2-4fca-8cfc-00a548266272 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:42:27.468644 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:27.469339 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:27.475455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.475937 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.476370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.477053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.477503 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.477922 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.481402 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:27.558944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:27.567218 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-906ae2f7-67fe-49c7-bf3c-2acec29efc9e tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1319 microversion: 2.1 time: 0.509046 Aug 24 15:42:27.567793 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 294/577] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:27 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:27.578810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:27.578810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:27.581421 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.581903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.582332 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.583042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.583500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.583901 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.616069 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8f4b4fb8-d51a-467a-9c5e-6e4916f17871 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047172 Aug 24 15:42:27.616634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 295/578] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:27 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:27.671799 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:27.679755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-bc42190c-1776-4975-8f11-2e919840c6d2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1506 microversion: 2.1 time: 0.215148 Aug 24 15:42:27.680487 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 284/579] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:27 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:27.782940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-bbb9d2e2-127c-4da1-bbf2-8a12c96d4138 req-66966b95-35ef-40fa-b5de-e9f824ada4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da59b0b3-378a-4907-8473-846ab2ce37df", "name": "network-vif-deleted", "tag": "f83d22fb-2a97-4cad-8349-827b7079f906"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:27.796483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-bbb9d2e2-127c-4da1-bbf2-8a12c96d4138 req-66966b95-35ef-40fa-b5de-e9f824ada4b1 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.796967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-bbb9d2e2-127c-4da1-bbf2-8a12c96d4138 req-66966b95-35ef-40fa-b5de-e9f824ada4b1 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.797400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-bbb9d2e2-127c-4da1-bbf2-8a12c96d4138 req-66966b95-35ef-40fa-b5de-e9f824ada4b1 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.811025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-bbb9d2e2-127c-4da1-bbf2-8a12c96d4138 req-66966b95-35ef-40fa-b5de-e9f824ada4b1 service nova] Creating event network-vif-deleted:f83d22fb-2a97-4cad-8349-827b7079f906 for instance da59b0b3-378a-4907-8473-846ab2ce37df on hv-cinder-84605 Aug 24 15:42:27.819080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-bbb9d2e2-127c-4da1-bbf2-8a12c96d4138 req-66966b95-35ef-40fa-b5de-e9f824ada4b1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039515 Aug 24 15:42:27.820053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 296/580] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:28.590379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:28.590970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:28.597590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.598098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.598534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.599261 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.599714 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.600141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.630038 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:28.632440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:28.641692 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.642312 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.642801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.643529 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.643976 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.644418 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.674527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-727baa35-e7c1-435c-80de-ba90c6423034 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048681 Aug 24 15:42:28.675127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 297/581] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:28 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:28.701423 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:28.702030 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:28.707910 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.708389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.708864 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.709528 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.709980 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.710400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.734576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:28.742325 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-27e29401-ee43-47d6-9345-1409c843fd48 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1508 microversion: 2.1 time: 0.156231 Aug 24 15:42:28.742927 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 285/582] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:28 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:28.743060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.743492 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.743921 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.744362 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lazy-loading 'fault' on Instance uuid da59b0b3-378a-4907-8473-846ab2ce37df {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:28.764596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6099ca82-b8d4-4d18-9c24-ae5dc352c613", "device": "/dev/sdb"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:28.767571 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:28.774473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.775115 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.776143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.777512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.778132 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.778765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.791867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:28.800507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-404030e2-7c29-4eb4-aac0-e7a62e88cf82 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 200 len: 1311 microversion: 2.1 time: 0.102958 Aug 24 15:42:28.801453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 298/583] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:28 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:29.088925 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-285554069"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:29.090164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:29.100462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.101060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.101721 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.102970 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.103638 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.104325 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.269540 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c4165d10-8137-43b2-aa0e-e9f896741fe2 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "POST /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509518 Aug 24 15:42:29.270435 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 286/584] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:42:28 2022] POST /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:29.304337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.network.security_group_api [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Removing security group 19129c0c-0209-4609-ae42-a24e14085421 from port c4f2df01-be68-4ea2-b398-f784a2bbe163 Aug 24 15:42:29.649273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-211f192d-e511-4dc9-ae60-5bc7dfdb4407 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/action" status: 202 len: 0 microversion: 2.1 time: 0.564017 Aug 24 15:42:29.649273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 299/585] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:42:29 2022] POST /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:42:29.687769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:29.690983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:29.698313 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.699825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.700682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.701664 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.702293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.703036 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.736157 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ca98cc0d-ff1d-44b8-bc25-4d2f070468d0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052908 Aug 24 15:42:29.737097 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 287/586] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:29 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:42:29.809591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:29.810385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:29.817311 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.818175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.818829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.819690 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.820304 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.820925 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.821800 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:29.822412 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: da59b0b3-378a-4907-8473-846ab2ce37df] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:29.838965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.840215 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.840953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.842015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.842931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.843669 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.851227 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:29.865300 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] HTTP exception thrown: Instance da59b0b3-378a-4907-8473-846ab2ce37df could not be found. Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Request method failure captured: Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df HTTP/1.1 Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5CZt0tAlR3mpFR4ggVXXsyZBdFuqvdWobkUmWkxTjTRtSDtWM9_GQyWYV6ysWKWS443Z7qgWdmOM3dWNy8gtlL03uN_kM2Q37BeuiXM6LlrsK3kP9qzaBe69YpoNR5Ru0sqJnrd5A2-7UiTCtqDB6WyTMwmEMfFY1vZEtgUhvYJk Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:42:29.892331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d204b26857042e397b91be285fa3ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d204b26857042e397b91be285fa3ed9"}]}] Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 4dd615d7af7741b08cc44b6c983fae49 Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance da59b0b3-378a-4907-8473-846ab2ce37df could not be found. Aug 24 15:42:29.894228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'da59b0b3-378a-4907-8473-846ab2ce37df'} Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da59b0b3-378a-4907-8473-846ab2ce37df could not be found. Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:29.895364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da59b0b3-378a-4907-8473-846ab2ce37df could not be found. Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da59b0b3-378a-4907-8473-846ab2ce37df could not be found. Aug 24 15:42:29.896829 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:29.898920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Returning 404 to user: Instance da59b0b3-378a-4907-8473-846ab2ce37df could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:29.900024 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-948b7326-560a-45a5-af68-9d2792132bc2 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df" status: 404 len: 111 microversion: 2.1 time: 0.082468 Aug 24 15:42:29.900809 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 288/587] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:29 2022] GET /compute/v2.1/servers/da59b0b3-378a-4907-8473-846ab2ce37df => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:42:29.906898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-7ce65a4f-1374-431f-a43d-08714e0c0d0c req-adffb96d-2ca4-4688-91d2-b16fc56adcfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d42888-8264-452f-ae88-fba52364c8c7", "tag": "c4f2df01-be68-4ea2-b398-f784a2bbe163"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:29.920886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7ce65a4f-1374-431f-a43d-08714e0c0d0c req-adffb96d-2ca4-4688-91d2-b16fc56adcfd service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.921990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7ce65a4f-1374-431f-a43d-08714e0c0d0c req-adffb96d-2ca4-4688-91d2-b16fc56adcfd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.923197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7ce65a4f-1374-431f-a43d-08714e0c0d0c req-adffb96d-2ca4-4688-91d2-b16fc56adcfd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.942386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-7ce65a4f-1374-431f-a43d-08714e0c0d0c req-adffb96d-2ca4-4688-91d2-b16fc56adcfd service nova] Creating event network-changed:c4f2df01-be68-4ea2-b398-f784a2bbe163 for instance 88d42888-8264-452f-ae88-fba52364c8c7 on hv-cinder-84605 Aug 24 15:42:29.952424 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-7ce65a4f-1374-431f-a43d-08714e0c0d0c req-adffb96d-2ca4-4688-91d2-b16fc56adcfd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049439 Aug 24 15:42:29.953692 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 289/588] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:29.962675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:29.963455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:29.972978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.973468 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.974818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.976055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.976579 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.977025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.986379 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-63b50e87-bd7f-4472-97e3-f99d1d190ea4 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 204 len: 0 microversion: 2.1 time: 0.179495 Aug 24 15:42:29.991348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 300/589] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:29 2022] DELETE /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:42:30.000614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:30.001738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:30.008407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.008905 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.009244 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:30.009962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:30.010707 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.011954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.012840 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:30.086210 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4878d788-581a-45de-b3ea-b7173db67d14 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 204 len: 0 microversion: 2.1 time: 0.129800 Aug 24 15:42:30.086949 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 290/590] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:29 2022] DELETE /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:42:30.095361 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:30.096135 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:30.101787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.102260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.102726 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:30.103406 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.103851 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.104260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:30.296604 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:30.304246 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2027ca75-7b24-4908-8b48-c59cc6af55a7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1681 microversion: 2.1 time: 0.310915 Aug 24 15:42:30.304823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 301/591] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:29 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:30.351781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:30.368705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1f6cb5c1-2c2d-44fd-bde9-e1b7486dbd2c tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.277383 Aug 24 15:42:30.369506 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 291/592] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:30 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:30.960951 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:30.961497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:30.968653 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.969205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.969724 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:30.970474 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.971010 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.971493 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.054965 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lazy-loading 'services' on Instance uuid 88d42888-8264-452f-ae88-fba52364c8c7 {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:31.130240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cf0a3ea4-ea4c-423f-ac92-d7f31a8708f2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments/fa924272-ea78-45ea-8ab1-571ef138ee3b" status: 202 len: 0 microversion: 2.1 time: 0.173040 Aug 24 15:42:31.131168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 302/593] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:42:30 2022] DELETE /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments/fa924272-ea78-45ea-8ab1-571ef138ee3b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:31.139584 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:31.141972 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:31.148628 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.149106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.149536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.150220 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.150695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.151115 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.181235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ab6153fe-3f22-48f7-a5f8-aed77f5de7ca tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Aug 24 15:42:31.181802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 292/594] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:31 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:31.410859 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:31.411566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:31.420788 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.421820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.422535 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.423500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.424394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.425040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.454661 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:31.455635 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:31.463236 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.464915 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.465462 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.466079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.466530 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.466978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.637417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:31.645678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a8dc00b3-f115-4ef5-b261-d7a4113b5f7b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1681 microversion: 2.1 time: 0.321664 Aug 24 15:42:31.646301 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 303/595] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:31 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1681 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:31.654993 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:31.662595 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-131f8f0a-4593-49d8-a6f5-a13532ae60be tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.276258 Aug 24 15:42:31.663250 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 293/596] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:31 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:31.970864 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-5f3bf198-021b-4ede-a830-19e0a0e1b5c2 req-e18bbb14-2107-4019-9206-9f4488867b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d42888-8264-452f-ae88-fba52364c8c7", "tag": "c4f2df01-be68-4ea2-b398-f784a2bbe163"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:31.982273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-5f3bf198-021b-4ede-a830-19e0a0e1b5c2 req-e18bbb14-2107-4019-9206-9f4488867b67 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.982780 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-5f3bf198-021b-4ede-a830-19e0a0e1b5c2 req-e18bbb14-2107-4019-9206-9f4488867b67 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.983205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-5f3bf198-021b-4ede-a830-19e0a0e1b5c2 req-e18bbb14-2107-4019-9206-9f4488867b67 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.993857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-5f3bf198-021b-4ede-a830-19e0a0e1b5c2 req-e18bbb14-2107-4019-9206-9f4488867b67 service nova] Creating event network-changed:c4f2df01-be68-4ea2-b398-f784a2bbe163 for instance 88d42888-8264-452f-ae88-fba52364c8c7 on hv-cinder-84605 Aug 24 15:42:31.998738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-5f3bf198-021b-4ede-a830-19e0a0e1b5c2 req-e18bbb14-2107-4019-9206-9f4488867b67 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031674 Aug 24 15:42:31.999309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 304/597] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:32.193615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:32.195825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:32.203093 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:32.203566 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:32.204027 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:32.204713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:32.205161 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:32.205599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:32.234649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-48e20fca-859e-4c49-9177-6fb3d93e0a2e tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 24 15:42:32.235233 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 294/598] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:32 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:32.669121 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:32.669870 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:32.676024 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:32.676505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:32.676940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:32.677628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:32.678084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:32.678507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:32.684618 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:32.685309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:32.691138 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:32.691617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:32.692050 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:32.692731 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:32.693179 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:32.693604 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:32.876766 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:32.883627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:32.884449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-46fc62cd-7c8c-484c-81b2-c99d9e45f418 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1681 microversion: 2.1 time: 0.219843 Aug 24 15:42:32.885023 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 305/599] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:32 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:32.892404 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fb3f5fac-4f53-4f7f-9232-a9140bc5787a tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.212656 Aug 24 15:42:32.892987 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 295/600] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:32 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:33.247960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:33.250054 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:33.256381 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:33.256840 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:33.257261 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:33.257932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:33.258371 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:33.258816 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:33.287627 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-072503f4-16dd-416f-9467-b3a76f026962 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Aug 24 15:42:33.288167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 306/601] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:33 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:33.906550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:33.907137 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:33.913057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:33.913767 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:33.914289 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:33.914804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:33.915526 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:33.916232 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:33.916687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:33.917111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:33.920453 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:33.920931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:33.921358 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:33.922042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:33.922556 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:33.923149 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:34.118596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:34.122085 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:34.126559 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5c1a5fe1-9162-4575-ab8f-26ec0ecb09dd tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1681 microversion: 2.1 time: 0.223955 Aug 24 15:42:34.127164 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 296/602] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:33 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:34.130795 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d7fa77ce-ebd4-465d-b02b-ce10278dd676 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.220804 Aug 24 15:42:34.130795 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 307/603] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:33 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:34.301261 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:34.303449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:34.309304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:34.310516 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:34.311178 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:34.311856 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:34.312304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:34.312722 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:34.342815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1c217215-3cbf-4511-8740-ca301a51f0e2 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045473 Aug 24 15:42:34.343274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 297/604] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:34 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:35.149689 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:35.150302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:35.151249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:35.151863 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:35.157141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:35.157609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:35.158045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:35.158768 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:35.158889 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:35.159229 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:35.159388 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:35.159656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:35.159816 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:35.160498 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:35.160948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:35.161366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:35.407563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:35.416035 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1b966f82-1cc6-4f74-83e2-ac103d2465d8 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1520 microversion: 2.1 time: 0.268377 Aug 24 15:42:35.416758 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 298/605] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:35 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:35.422037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:35.422587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:35.425133 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:35.426318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:35.432808 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:35.433303 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:35.433741 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:35.434500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:35.434726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-24ac44d6-b00e-47eb-87d4-965b314ccc2b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1681 microversion: 2.1 time: 0.288349 Aug 24 15:42:35.435036 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:35.435422 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:35.436184 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 308/606] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:35 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:35.441111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:35.469797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-25969776-1411-4766-9708-9c99720e339b tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051544 Aug 24 15:42:35.470369 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 299/607] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:35 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:36.039766 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-d732dafa-414e-48bd-88cc-95a43630bfd8 req-2d2ba0d9-0fee-402d-9139-f478bd0a994a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9197f87-6b4b-48c3-82b6-291e3fa22b44", "name": "network-vif-deleted", "tag": "d16aa60b-75fe-494c-ab0b-80320b598060"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:36.061639 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-d732dafa-414e-48bd-88cc-95a43630bfd8 req-2d2ba0d9-0fee-402d-9139-f478bd0a994a service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.062136 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-d732dafa-414e-48bd-88cc-95a43630bfd8 req-2d2ba0d9-0fee-402d-9139-f478bd0a994a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.062729 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-d732dafa-414e-48bd-88cc-95a43630bfd8 req-2d2ba0d9-0fee-402d-9139-f478bd0a994a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.078633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-d732dafa-414e-48bd-88cc-95a43630bfd8 req-2d2ba0d9-0fee-402d-9139-f478bd0a994a service nova] Creating event network-vif-deleted:d16aa60b-75fe-494c-ab0b-80320b598060 for instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 on hv-cinder-84605 Aug 24 15:42:36.086116 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-d732dafa-414e-48bd-88cc-95a43630bfd8 req-2d2ba0d9-0fee-402d-9139-f478bd0a994a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050321 Aug 24 15:42:36.087100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 309/608] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:36.440833 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:36.442029 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:36.458436 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.459362 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.460140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.460407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:36.461182 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.461668 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.462003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:36.462112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.470243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.471091 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.471724 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.472641 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.473297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.474103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.522110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.522603 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.523064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.523519 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lazy-loading 'fault' on Instance uuid c9197f87-6b4b-48c3-82b6-291e3fa22b44 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:36.690428 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd615d7af7741b08cc44b6c983fae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d204b26857042e397b91be285fa3ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:36.690892 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:36.701196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3f333a36-01f1-4562-8a1d-037fdc09dab1 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 200 len: 1311 microversion: 2.1 time: 0.263959 Aug 24 15:42:36.702533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-507a614c-511a-4473-95fd-cdcb6cfc460b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 200 len: 1614 microversion: 2.1 time: 0.248746 Aug 24 15:42:36.715709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 300/609] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:36 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 1311 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:36.722170 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:36.723728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 310/610] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:36 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 1614 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:36.736876 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:36.744772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.745703 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.747026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.749920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.754262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.755005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.803206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ac7a6a29-b2e5-4010-956b-837d5ff23008 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085906 Aug 24 15:42:36.804203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 301/611] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:36 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:42:36.819012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:36.819546 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:36.826528 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.827415 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.827852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.828739 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:36.829203 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:36.829627 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:36.913804 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] HTTP exception thrown: Instance 88d42888-8264-452f-ae88-fba52364c8c7 is not attached to volume fa924272-ea78-45ea-8ab1-571ef138ee3b Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Request method failure captured: Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments/fa924272-ea78-45ea-8ab1-571ef138ee3b HTTP/1.1 Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkZIF4nalB9lakwf08-DoNBCLpyP27W7PAlMzoZwF0sorY5l-xWlfRqmBTCn3gkuM-EfR0LAMeh8SCKbU7_zhOZfwtpTDoIEiC647NjS8wL_hBGqSmcN3fAyaJDckzc22bEAU0suDgThbF4aRwQp9MEQUPBSEKiQAMqLVA37WnngWr8 Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0159b61c064b4eca9fcb9ed3c1fff2b5 Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-TestMinimumBasicScenario-1661032439 Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:42:36.916477 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0159b61c064b4eca9fcb9ed3c1fff2b5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0159b61c064b4eca9fcb9ed3c1fff2b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0159b61c064b4eca9fcb9ed3c1fff2b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0159b61c064b4eca9fcb9ed3c1fff2b5"}]}] Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-TestMinimumBasicScenario-1661032439 Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0159b61c064b4eca9fcb9ed3c1fff2b5 Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1661032439 Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-TestMinimumBasicScenario-1661032439-project Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 0c0cd616a3794428809f28dfbc86e7b9 Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-TestMinimumBasicScenario-1661032439-project Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:42:36.917857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 88d42888-8264-452f-ae88-fba52364c8c7 is not attached to volume fa924272-ea78-45ea-8ab1-571ef138ee3b Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'server_id': '88d42888-8264-452f-ae88-fba52364c8c7', 'id': 'fa924272-ea78-45ea-8ab1-571ef138ee3b'} Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fa924272-ea78-45ea-8ab1-571ef138ee3b. Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:36.918615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d42888-8264-452f-ae88-fba52364c8c7 is not attached to volume fa924272-ea78-45ea-8ab1-571ef138ee3b Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d42888-8264-452f-ae88-fba52364c8c7 is not attached to volume fa924272-ea78-45ea-8ab1-571ef138ee3b Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:36.920560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Returning 404 to user: Instance 88d42888-8264-452f-ae88-fba52364c8c7 is not attached to volume fa924272-ea78-45ea-8ab1-571ef138ee3b {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:36.921651 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f6eb5b83-d45f-42af-b663-399844b96ba9 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments/fa924272-ea78-45ea-8ab1-571ef138ee3b" status: 404 len: 154 microversion: 2.1 time: 0.106536 Aug 24 15:42:36.921651 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 311/612] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:42:36 2022] DELETE /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7/os-volume_attachments/fa924272-ea78-45ea-8ab1-571ef138ee3b => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:37.726503 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:37.727064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] [instance: c9197f87-6b4b-48c3-82b6-291e3fa22b44] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:37.733968 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:37.734446 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:37.734914 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:37.735075 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:37.735614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:37.735777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:37.736067 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:37.736494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:37.742168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:37.742678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:37.743127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:37.743827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:37.744317 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:37.744743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:37.750514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] HTTP exception thrown: Instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 could not be found. Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Request method failure captured: Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 HTTP/1.1 Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5CZt0tAlR3mpFR4ggVXXsyZBdFuqvdWobkUmWkxTjTRtSDtWM9_GQyWYV6ysWKWS443Z7qgWdmOM3dWNy8gtlL03uN_kM2Q37BeuiXM6LlrsK3kP9qzaBe69YpoNR5Ru0sqJnrd5A2-7UiTCtqDB6WyTMwmEMfFY1vZEtgUhvYJk Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:42:37.752196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d204b26857042e397b91be285fa3ed9", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d204b26857042e397b91be285fa3ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d204b26857042e397b91be285fa3ed9"}]}] Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 3d204b26857042e397b91be285fa3ed9 Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1448082019 Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 4dd615d7af7741b08cc44b6c983fae49 Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1448082019-project Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 could not be found. Aug 24 15:42:37.753695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'c9197f87-6b4b-48c3-82b6-291e3fa22b44'} Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 could not be found. Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:37.754676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 could not be found. Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 could not be found. Aug 24 15:42:37.756634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.758218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] Returning 404 to user: Instance c9197f87-6b4b-48c3-82b6-291e3fa22b44 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:37.758218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-54ec389b-69a3-4541-9378-533fef7c1586 tempest-ServerRescueNegativeTestJSON-1448082019 tempest-ServerRescueNegativeTestJSON-1448082019-project] 10.222.0.73 "GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44" status: 404 len: 111 microversion: 2.1 time: 0.031047 Aug 24 15:42:37.758218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 302/613] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:37 2022] GET /compute/v2.1/servers/c9197f87-6b4b-48c3-82b6-291e3fa22b44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:42:37.759542 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b HTTP/1.1 Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:42:37.761585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:42:37.764299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b'} Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:37.765633 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:42:37.767561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:37.769725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:37.769725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-da7e9208-9e34-4422-b15a-3e5ff7dac758 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 404 len: 111 microversion: 2.1 time: 0.032305 Aug 24 15:42:37.769725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 312/614] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:37 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:42:37.775159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-26958f17-857c-4998-9bd3-dfb34ced40a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '.version_select at 0x7f07834a6b80>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:37.794621 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-26958f17-857c-4998-9bd3-dfb34ced40a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467759548" status: 202 len: 0 microversion: 2.1 time: 0.023009 Aug 24 15:42:37.795360 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 303/615] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 15:42:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467759548 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:38.108496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:38.109053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:38.115549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:38.116180 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:38.116711 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:38.117513 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:38.118060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:38.118579 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:38.146443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:38.231187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-6e35b724-0db7-481c-b274-ae358c0acf78 req-69c71bac-69a1-495f-8796-0ef8e5cfc742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b", "name": "network-vif-deleted", "tag": "b97df505-95e6-44e6-b833-4fc18dc0cdf2"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:38.244793 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6e35b724-0db7-481c-b274-ae358c0acf78 req-69c71bac-69a1-495f-8796-0ef8e5cfc742 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:38.250941 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6e35b724-0db7-481c-b274-ae358c0acf78 req-69c71bac-69a1-495f-8796-0ef8e5cfc742 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:38.251810 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6e35b724-0db7-481c-b274-ae358c0acf78 req-69c71bac-69a1-495f-8796-0ef8e5cfc742 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:38.257801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c67dd4ac-c746-4a0e-91df-a5ae069f7f9f tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 204 len: 0 microversion: 2.1 time: 0.153626 Aug 24 15:42:38.258383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 313/616] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:38 2022] DELETE /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:42:38.268348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:38.269289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:38.272025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-6e35b724-0db7-481c-b274-ae358c0acf78 req-69c71bac-69a1-495f-8796-0ef8e5cfc742 service nova] Creating event network-vif-deleted:b97df505-95e6-44e6-b833-4fc18dc0cdf2 for instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b on hv-cinder-84605 Aug 24 15:42:38.275908 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:38.276420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:38.276838 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:38.277512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-6e35b724-0db7-481c-b274-ae358c0acf78 req-69c71bac-69a1-495f-8796-0ef8e5cfc742 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049975 Aug 24 15:42:38.277724 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:38.278186 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:38.278627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 304/617] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:38.279022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:38.505108 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:38.515338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c579afd1-cac9-435a-a66d-b564fd5655b5 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1554 microversion: 2.1 time: 0.252516 Aug 24 15:42:38.516421 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 314/618] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:38 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:38.574180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1de5b321-1841-4794-8010-a12b84a9342b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: .version_select at 0x7f078345c940>, body: {"keypair": {"name": "tempest-keypair-218688719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpMV7SkfXcFTxhsDCk2wcg/B03MW49iXjHRtDRq96Ribk8NpcsUJWclZkq0j61nJVo+ZWIfERZQETOGtGXaUDV6/tzmGWl/isIcLF+kJ7USjWcwdrlz9UBfB5U6p7iHng=="}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:38.589483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1de5b321-1841-4794-8010-a12b84a9342b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:42:38.593591 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1de5b321-1841-4794-8010-a12b84a9342b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:42:38.617181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1de5b321-1841-4794-8010-a12b84a9342b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047150 Aug 24 15:42:38.617785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 305/619] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:42:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:39.536634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:39.537962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:39.545258 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:39.546080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:39.546931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:39.547852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:39.549400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:39.550039 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:39.778863 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:39.795095 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-431843ec-c4a0-4444-97c7-47484572349d tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1554 microversion: 2.1 time: 0.262555 Aug 24 15:42:39.797239 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 315/620] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:39 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1554 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:40.361576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-942964995", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "105210c5-8b78-4e8c-bd12-9456d560212d"}], "security_groups": [{"name": "tempest-securitygroup--1574617240"}], "key_name": "tempest-keypair-218688719", "user_data": "}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:40.544112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] validate_networks() for [('105210c5-8b78-4e8c-bd12-9456d560212d', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:42:40.816794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:40.817406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:40.825034 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:40.830317 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:40.830793 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:40.839444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:40.839864 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:40.840301 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:41.141767 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:41.153123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4440716a-cd5b-4026-ad42-23e6c375b656 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1554 microversion: 2.1 time: 0.338291 Aug 24 15:42:41.153865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 316/621] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:40 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1554 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:41.226574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:42:41.227038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:42:41.227512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:42:41.227921 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:42:41.228331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:42:41.238427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:41.238963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:41.239382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:41.240268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:41.240870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:41.241466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:41.256251 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:41.268035 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:42:41.274211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Getting quotas for user 1541e1614d664891b1952379b003ed71 and project 0b8dd47a9d30492eb7163da543d874cb. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:42:41.290269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:42:41.292862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:42:41.360605 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4637ab8d-3855-4fe6-93f4-3c2e35cac3a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.004692 Aug 24 15:42:41.361281 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 306/622] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:42:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:42:41.371878 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-cb8b38b3-edcd-4ded-8317-865810a55a2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:41.372765 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-cb8b38b3-edcd-4ded-8317-865810a55a2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:41.459556 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-cb8b38b3-edcd-4ded-8317-865810a55a2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:41.475709 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-cb8b38b3-edcd-4ded-8317-865810a55a2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1240 microversion: 2.1 time: 0.107484 Aug 24 15:42:41.476583 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 317/623] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:41 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:41.997920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:41.998455 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:42.005407 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:42.005895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:42.006612 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:42.007493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:42.008110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:42.008569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:42.032820 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d46bc781-576c-4d4b-8a64-6f23948efaf7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/ips" status: 200 len: 145 microversion: 2.1 time: 0.250705 Aug 24 15:42:42.038706 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 307/624] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:42:41 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/ips => generated 145 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:42.174502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:42.175899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:42.183097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:42.183803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:42.184296 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:42.185047 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:42.185822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:42.186368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:42.374354 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:42.382896 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c1bf1903-d415-4dbb-b8f3-b0a1e6fac548 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1554 microversion: 2.1 time: 0.212458 Aug 24 15:42:42.383527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 318/625] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:42 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:42.496578 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:42.498054 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:42.504105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:42.504584 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:42.505071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:42.505838 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:42.506298 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:42.506746 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:42.575743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:42.583303 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d64c2fe2-e57c-4a5f-bf86-db2e75399c2d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1244 microversion: 2.1 time: 0.090621 Aug 24 15:42:42.584051 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 308/626] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:42 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:43.405522 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:43.406228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:43.413267 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:43.414029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:43.414685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:43.415603 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:43.416284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:43.416782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:43.583320 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:43.593647 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3f16b81e-2b24-4133-b0cf-5709982d13d1 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1554 microversion: 2.1 time: 0.193010 Aug 24 15:42:43.594250 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 319/627] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:43 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:43.605952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:43.608617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:43.616005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:43.616690 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:43.617200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:43.618016 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:43.618512 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:43.619055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:43.690933 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:43.699587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-281d200b-8b6b-4253-9d44-60632bea549a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1244 microversion: 2.1 time: 0.099016 Aug 24 15:42:43.701126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 309/628] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:43 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:44.616156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:44.617471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:44.626435 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:44.627140 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:44.627754 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:44.630167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:44.630737 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:44.631484 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:44.725466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:44.726889 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:44.734955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:44.737106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:44.737759 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:44.739147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:44.744014 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:44.746981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:44.902738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:44.910843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4ed21607-096a-44e3-b231-dac140f5b8dc tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1236 microversion: 2.1 time: 0.192620 Aug 24 15:42:44.911768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 310/629] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:44 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1236 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:44.963361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:44.986713 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e65ca82f-2604-4be0-bb17-af7b4cf330b6 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1554 microversion: 2.1 time: 0.374211 Aug 24 15:42:45.001822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 320/630] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:44 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1554 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:45.477650 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-f4b7c5da-a56b-49db-a539-d2f312592cf8 req-6a786a7b-1877-48cb-9ee6-a10293f374fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d42888-8264-452f-ae88-fba52364c8c7", "name": "network-vif-deleted", "tag": "c4f2df01-be68-4ea2-b398-f784a2bbe163"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:45.488013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-f4b7c5da-a56b-49db-a539-d2f312592cf8 req-6a786a7b-1877-48cb-9ee6-a10293f374fd service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:45.488484 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-f4b7c5da-a56b-49db-a539-d2f312592cf8 req-6a786a7b-1877-48cb-9ee6-a10293f374fd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:45.489094 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-f4b7c5da-a56b-49db-a539-d2f312592cf8 req-6a786a7b-1877-48cb-9ee6-a10293f374fd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:45.503409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-f4b7c5da-a56b-49db-a539-d2f312592cf8 req-6a786a7b-1877-48cb-9ee6-a10293f374fd service nova] Creating event network-vif-deleted:c4f2df01-be68-4ea2-b398-f784a2bbe163 for instance 88d42888-8264-452f-ae88-fba52364c8c7 on hv-cinder-84605 Aug 24 15:42:45.510327 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-f4b7c5da-a56b-49db-a539-d2f312592cf8 req-6a786a7b-1877-48cb-9ee6-a10293f374fd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037010 Aug 24 15:42:45.515800 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 311/631] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:45.544749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50451e92-a7fd-4996-86ad-bee5c9e4215a"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:45.547696 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:45.550884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:45.556530 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:45.557020 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:45.557643 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:45.558368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:45.559082 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:45.560241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:45.933142 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:45.933760 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:45.943210 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:45.943977 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:45.947308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:45.948514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:45.949121 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:45.949780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:46.116326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:46.125257 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2ca05e14-f5ba-4104-bc02-f456a7f9a40e tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1298 microversion: 2.1 time: 0.197054 Aug 24 15:42:46.131383 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 312/632] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:45 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1298 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:46.149114 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:46.150770 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:46.166443 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:46.167328 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:46.168870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:46.169881 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:46.170506 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:46.173996 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:46.218428 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:46.219374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:46.220064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:46.220773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lazy-loading 'fault' on Instance uuid 88d42888-8264-452f-ae88-fba52364c8c7 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:46.221540 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2c73bfbf-8ae5-405c-bf3e-40aa21987b4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680550 Aug 24 15:42:46.223348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 321/633] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:42:45 2022] POST /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:46.368001 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0cd616a3794428809f28dfbc86e7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159b61c064b4eca9fcb9ed3c1fff2b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:46.379602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0472fcc0-3a79-4539-8b04-b680e1dfe078 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 200 len: 1347 microversion: 2.1 time: 0.246819 Aug 24 15:42:46.380688 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 313/634] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:46 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 1347 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:47.150832 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:47.151851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:47.160967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:47.161804 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:47.162207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:47.163224 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:47.163734 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:47.164196 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:47.330563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:47.345681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e702ab69-cbde-49c3-98bf-4e03d8119694 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.199453 Aug 24 15:42:47.355786 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 322/635] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:47 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:47.403756 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:47.405056 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] [instance: 88d42888-8264-452f-ae88-fba52364c8c7] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:47.411927 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:47.412493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:47.412998 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:47.413798 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:47.414317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:47.414986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:47.429553 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] HTTP exception thrown: Instance 88d42888-8264-452f-ae88-fba52364c8c7 could not be found. Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Request method failure captured: Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 HTTP/1.1 Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkZIF4nalB9lakwf08-DoNBCLpyP27W7PAlMzoZwF0sorY5l-xWlfRqmBTCn3gkuM-EfR0LAMeh8SCKbU7_zhOZfwtpTDoIEiC647NjS8wL_hBGqSmcN3fAyaJDckzc22bEAU0suDgThbF4aRwQp9MEQUPBSEKiQAMqLVA37WnngWr8 Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0159b61c064b4eca9fcb9ed3c1fff2b5 Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-TestMinimumBasicScenario-1661032439 Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:42:47.431254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0159b61c064b4eca9fcb9ed3c1fff2b5", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0159b61c064b4eca9fcb9ed3c1fff2b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0159b61c064b4eca9fcb9ed3c1fff2b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0159b61c064b4eca9fcb9ed3c1fff2b5"}]}] Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-TestMinimumBasicScenario-1661032439 Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0159b61c064b4eca9fcb9ed3c1fff2b5 Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1661032439 Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-TestMinimumBasicScenario-1661032439-project Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 0c0cd616a3794428809f28dfbc86e7b9 Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-TestMinimumBasicScenario-1661032439-project Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 88d42888-8264-452f-ae88-fba52364c8c7 could not be found. Aug 24 15:42:47.432673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '88d42888-8264-452f-ae88-fba52364c8c7'} Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d42888-8264-452f-ae88-fba52364c8c7 could not be found. Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:47.433751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d42888-8264-452f-ae88-fba52364c8c7 could not be found. Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d42888-8264-452f-ae88-fba52364c8c7 could not be found. Aug 24 15:42:47.435734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:42:47.438258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Returning 404 to user: Instance 88d42888-8264-452f-ae88-fba52364c8c7 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:47.438258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cacd6c14-6687-4c94-b497-7e19f6fcaf85 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7" status: 404 len: 111 microversion: 2.1 time: 0.033228 Aug 24 15:42:47.438258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 314/636] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:47 2022] GET /compute/v2.1/servers/88d42888-8264-452f-ae88-fba52364c8c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:47.441451 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4b526b23-e017-4304-9f7b-fa4944a6fa77 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] Calling method '.version_select at 0x7f07905850d0>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:47.465403 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4b526b23-e017-4304-9f7b-fa4944a6fa77 tempest-TestMinimumBasicScenario-1661032439 tempest-TestMinimumBasicScenario-1661032439-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-955769496" status: 202 len: 0 microversion: 2.1 time: 0.027639 Aug 24 15:42:47.467278 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 323/637] 10.222.0.73 () {58 vars in 1269 bytes} [Wed Aug 24 15:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-955769496 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:48.369802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:48.370730 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:48.380011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:48.381497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:48.382106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:48.383203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:48.383823 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:48.384878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:48.805229 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:48.821002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-79d27c66-2a75-40ab-8802-77f6ec503541 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.456218 Aug 24 15:42:48.827276 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 315/638] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:48 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:48.976489 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-0965af0f-4a61-4e92-8ceb-7a7fcad9b755 req-b29b28ef-c0be-46dd-89e9-188956a22350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5ba349-889b-48e9-a144-173d715cc532", "tag": "1f59ed6f-c2a7-4b96-887e-58d69156e466"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:48.991722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-0965af0f-4a61-4e92-8ceb-7a7fcad9b755 req-b29b28ef-c0be-46dd-89e9-188956a22350 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:48.992929 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-0965af0f-4a61-4e92-8ceb-7a7fcad9b755 req-b29b28ef-c0be-46dd-89e9-188956a22350 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:48.993815 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-0965af0f-4a61-4e92-8ceb-7a7fcad9b755 req-b29b28ef-c0be-46dd-89e9-188956a22350 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:49.011554 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-0965af0f-4a61-4e92-8ceb-7a7fcad9b755 req-b29b28ef-c0be-46dd-89e9-188956a22350 service nova] Creating event network-changed:1f59ed6f-c2a7-4b96-887e-58d69156e466 for instance 2e5ba349-889b-48e9-a144-173d715cc532 on hv-cinder-84605 Aug 24 15:42:49.018318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-0965af0f-4a61-4e92-8ceb-7a7fcad9b755 req-b29b28ef-c0be-46dd-89e9-188956a22350 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292843 Aug 24 15:42:49.019670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 324/639] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:49.180082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:49.181210 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:49.204723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:49.207761 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:49.208949 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:49.209938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:49.212508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:49.213229 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:49.365516 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lazy-loading 'services' on Instance uuid 5c368641-febc-420a-926d-929cb66d0ec6 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:49.470267 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8364ce7a-0b00-4935-bd4b-056548f4bb0c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'create', calling method: .version_select at 0x7f079059caf0>, body: {"keypair": {"name": "tempest-keypair-83946513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDTpLflsC0QQzzOqc8B+F8EG9xqSvfPG+PdekJE00xmi0zB7AA6mzOSBMsyttzydPPYCjl6EgtiW2jLcEhJtVXJFKrXQwRBqM2VWRRJmfTe3SjY5/T3gz27Tf7AJ4fxcQ=="}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:49.472527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f713f527-d2f0-4dc4-a330-af50d980af02 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6/os-volume_attachments/6099ca82-b8d4-4d18-9c24-ae5dc352c613" status: 202 len: 0 microversion: 2.1 time: 0.296419 Aug 24 15:42:49.473126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 316/640] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:42:49 2022] DELETE /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6/os-volume_attachments/6099ca82-b8d4-4d18-9c24-ae5dc352c613 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:49.489020 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-8364ce7a-0b00-4935-bd4b-056548f4bb0c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for project 9b9728b1ee454013a3968c27080cd98c. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:42:49.494590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-8364ce7a-0b00-4935-bd4b-056548f4bb0c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for user e02f332ba23a4a3cacb99f5c69a5b524 and project 9b9728b1ee454013a3968c27080cd98c. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:42:49.531979 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8364ce7a-0b00-4935-bd4b-056548f4bb0c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.130612 Aug 24 15:42:49.538369 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 325/641] 10.222.0.73 () {62 vars in 1200 bytes} [Wed Aug 24 15:42:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 15:42:49.855024 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:49.855728 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:49.867342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:49.867846 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:49.868283 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:49.869588 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:49.870053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:49.870915 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:50.108890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:50.123811 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d43a2aec-6758-476d-be9f-e74c86c48c6b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.273286 Aug 24 15:42:50.139129 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 317/642] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:49 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:51.147692 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:51.148444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:51.157818 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:51.158562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:51.159173 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:51.160617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:51.161235 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:51.161851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:51.428491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:51.438123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2d9249be-8fca-4cbe-b3e6-aedca8691665 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.295899 Aug 24 15:42:51.452964 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 326/643] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:51 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:51.582222 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1446097453", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7978ebbc-163a-4438-8674-44dc5d815bb0"}], "security_groups": [{"name": "tempest-securitygroup--1706271449"}], "key_name": "tempest-keypair-83946513", "user_data": "}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:51.598931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:51.599925 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=10 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:51.749251 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] validate_networks() for [('7978ebbc-163a-4438-8674-44dc5d815bb0', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:42:52.459876 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:52.460487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:52.473409 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:52.473910 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:52.474344 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:52.475093 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:52.475549 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:52.475973 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:52.505064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:42:52.505683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:42:52.506416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:42:52.507216 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:42:52.507785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:42:52.509725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:52.521262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:52.521975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:52.522926 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:52.523839 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:52.524849 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:52.524966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:52.601817 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for project 9b9728b1ee454013a3968c27080cd98c. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:42:52.609856 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for user e02f332ba23a4a3cacb99f5c69a5b524 and project 9b9728b1ee454013a3968c27080cd98c. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:42:52.626856 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:42:52.630503 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:42:52.743697 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5571a1f6-4775-49e6-95ea-b1367dd8a9dc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.166031 Aug 24 15:42:52.744705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 318/644] 10.222.0.73 () {62 vars in 1188 bytes} [Wed Aug 24 15:42:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 15:42:52.755609 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f83a49a8-e2e3-4bfd-ac2a-c935abe8d3ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:52.756437 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f83a49a8-e2e3-4bfd-ac2a-c935abe8d3ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:52.854176 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:52.875559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4f22cc55-846a-422e-9ad0-d0e16b274479 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.413844 Aug 24 15:42:52.875559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 327/645] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:52 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:52.927873 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f83a49a8-e2e3-4bfd-ac2a-c935abe8d3ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:52.957510 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f83a49a8-e2e3-4bfd-ac2a-c935abe8d3ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:52.960796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f83a49a8-e2e3-4bfd-ac2a-c935abe8d3ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:52.965337 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f83a49a8-e2e3-4bfd-ac2a-c935abe8d3ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1280 microversion: 2.20 time: 0.213517 Aug 24 15:42:52.967057 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 319/646] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:42:52 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:42:53.078008 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:53.082501 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:53.091695 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.092623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.093651 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:53.095354 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.096092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.097607 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:53.212346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5a33060c-802b-44dd-95fd-f286442a88d6 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139695 Aug 24 15:42:53.213037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 328/647] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:53 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:53.223864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:53.224603 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:53.234451 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.234983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.238259 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:53.239287 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.239842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.240463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:53.285476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-98751ca0-1ea7-4090-a9c3-89648e1c9568 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/50451e92-a7fd-4996-86ad-bee5c9e4215a" status: 200 len: 194 microversion: 2.1 time: 0.065441 Aug 24 15:42:53.286833 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 320/648] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 15:42:53 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/50451e92-a7fd-4996-86ad-bee5c9e4215a => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:53.894383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:53.895147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:53.902044 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.902753 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.903408 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:53.904421 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.905725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.906360 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:53.988102 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:53.988622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:53.995069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.995558 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.996531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:53.997302 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:53.997757 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:53.998375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:54.027456 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:54.030430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:54.113604 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b53139bc-a516-4837-b0be-594f35ecec1d tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 204 len: 0 microversion: 2.1 time: 0.129379 Aug 24 15:42:54.114977 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 321/649] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:53 2022] DELETE /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:42:54.122273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:54.123432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:54.130531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:54.131278 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:54.131905 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:54.132849 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:54.134210 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:54.134929 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:54.144823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:54.152899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6d7f2506-52db-4b69-8cde-7573a6164dc1 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.262443 Aug 24 15:42:54.153506 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 329/650] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:53 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:54.173143 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:54.174481 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:54.185000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:54.186593 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:54.187698 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:54.188587 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:54.189276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:54.189865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:54.258071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:54.277093 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:54.279535 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:54.280839 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3092a452-cf37-4f32-8613-df94bbd2f5b3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1332 microversion: 2.20 time: 0.164371 Aug 24 15:42:54.281538 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 322/651] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:42:54 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1332 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:42:54.380360 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:54.388224 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d0e2d59a-9694-4f10-9613-c80750ff3968 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1514 microversion: 2.1 time: 0.220035 Aug 24 15:42:54.388931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 330/652] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:54 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:54.563035 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-c9fe012a-c235-4983-8d50-4849c8bfb390 req-7f721f75-72c6-4d9c-b798-0106ba1e0208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5ba349-889b-48e9-a144-173d715cc532", "name": "network-vif-plugged", "status": "completed", "tag": "1f59ed6f-c2a7-4b96-887e-58d69156e466"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:54.575198 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c9fe012a-c235-4983-8d50-4849c8bfb390 req-7f721f75-72c6-4d9c-b798-0106ba1e0208 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:54.575880 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c9fe012a-c235-4983-8d50-4849c8bfb390 req-7f721f75-72c6-4d9c-b798-0106ba1e0208 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:54.576648 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c9fe012a-c235-4983-8d50-4849c8bfb390 req-7f721f75-72c6-4d9c-b798-0106ba1e0208 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:54.589246 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-c9fe012a-c235-4983-8d50-4849c8bfb390 req-7f721f75-72c6-4d9c-b798-0106ba1e0208 service nova] Creating event network-vif-plugged:1f59ed6f-c2a7-4b96-887e-58d69156e466 for instance 2e5ba349-889b-48e9-a144-173d715cc532 on hv-cinder-84605 Aug 24 15:42:54.595249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-c9fe012a-c235-4983-8d50-4849c8bfb390 req-7f721f75-72c6-4d9c-b798-0106ba1e0208 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036666 Aug 24 15:42:54.595851 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 323/653] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:54.761427 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e50f6757-6d35-4d99-b01d-577ba3acf727"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:54.764851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:54.771859 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:54.772666 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:54.773124 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:54.773835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:54.774467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:54.775101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:55.174099 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:55.174812 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:55.181372 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:55.181843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:55.182266 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:55.182983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:55.183461 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:55.184008 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:55.327976 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:55.337119 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fa74ecd2-fcb7-49f7-9ec5-254fd9e8ed0d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.167127 Aug 24 15:42:55.337862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 324/654] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:55 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:55.342886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:55.343781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:55.349890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:55.350736 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:55.351407 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:55.352280 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:55.352736 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:55.353157 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:55.423265 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:55.432138 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:55.434431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:55.435797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8e2f391a-782f-4250-b89d-79b36a71de0d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1340 microversion: 2.20 time: 0.096753 Aug 24 15:42:55.436349 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 325/655] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:42:55 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:42:55.441143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:55.441743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:55.447844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:55.448321 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:55.448752 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:55.450087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:55.450778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:55.451201 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:55.593003 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:55.601708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a3bdc6c7-7b1b-410e-8c65-0091bd53fe2a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1514 microversion: 2.1 time: 0.164211 Aug 24 15:42:55.602284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 326/656] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:55 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:55.831193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1a5f1525-e004-40e8-8b34-ee3a1390034c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "POST /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.073834 Aug 24 15:42:55.832305 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 331/657] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:42:54 2022] POST /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments => generated 194 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:56.358536 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:56.359911 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:56.366732 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:56.367217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:56.367874 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:56.368589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:56.369103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:56.369464 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:56.460422 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:56.461362 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:56.471723 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:56.472529 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:56.473553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:56.474749 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:56.475493 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:56.476155 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:56.515284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:56.523129 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7370d20a-e7ee-4f5c-9ed3-44e8293938a5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1366 microversion: 2.1 time: 0.168858 Aug 24 15:42:56.523710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 327/658] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:56 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:56.566088 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:56.576014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:56.577924 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:56.579136 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-266ca520-f1a5-4aa6-9d87-870d5ae2d3a9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1338 microversion: 2.20 time: 0.123802 Aug 24 15:42:56.579988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 332/659] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:42:56 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1338 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:42:56.629086 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:56.630024 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:56.639427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:56.640044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:56.640590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:56.641486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:56.642166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:56.642859 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:56.811421 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:56.819002 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d2ff88cd-a5f2-47bb-b02c-623c3e9308d4 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1514 microversion: 2.1 time: 0.196847 Aug 24 15:42:56.819561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 328/660] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:56 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:57.545986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:57.546629 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:57.553420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.553915 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.554657 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.555363 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.555848 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.556291 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.585143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-c9d62e63-d4a1-40c8-b8a4-14809cad5b51 req-2a8e7343-efed-4fa7-95ca-e4736ceb0340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c368641-febc-420a-926d-929cb66d0ec6", "name": "network-vif-deleted", "tag": "66e33da5-8c21-43f1-8547-a5e3f65a9a42"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:57.604462 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c9d62e63-d4a1-40c8-b8a4-14809cad5b51 req-2a8e7343-efed-4fa7-95ca-e4736ceb0340 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.606336 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c9d62e63-d4a1-40c8-b8a4-14809cad5b51 req-2a8e7343-efed-4fa7-95ca-e4736ceb0340 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.606979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c9d62e63-d4a1-40c8-b8a4-14809cad5b51 req-2a8e7343-efed-4fa7-95ca-e4736ceb0340 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.626144 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-c9d62e63-d4a1-40c8-b8a4-14809cad5b51 req-2a8e7343-efed-4fa7-95ca-e4736ceb0340 service nova] Creating event network-vif-deleted:66e33da5-8c21-43f1-8547-a5e3f65a9a42 for instance 5c368641-febc-420a-926d-929cb66d0ec6 on hv-cinder-84605 Aug 24 15:42:57.634625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-c9d62e63-d4a1-40c8-b8a4-14809cad5b51 req-2a8e7343-efed-4fa7-95ca-e4736ceb0340 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056318 Aug 24 15:42:57.635850 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 329/661] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:42:57.641660 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:57.643751 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:57.664800 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.665298 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.665788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.666503 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.666978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.667764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.769111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:57.771508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:57.781960 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:57.784249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:57.786147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-eabaf3c7-f117-43ea-9d1f-88ea8b536650 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1338 microversion: 2.20 time: 0.149091 Aug 24 15:42:57.799004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-020ce0f8-b867-4ec8-a11d-0c4d26c9ea1c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1555 microversion: 2.1 time: 0.250650 Aug 24 15:42:57.799004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 333/662] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:57 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1555 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:57.799998 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 330/663] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:42:57 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1338 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:42:57.813160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:57.815119 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:57.822879 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.823374 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.823894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.824802 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.825428 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.826017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.841901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:57.842521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:57.848737 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.849398 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.849836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.850748 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.851392 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.852408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.902890 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:57.903449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:57.908988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:57.909504 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lazy-loading 'fault' on Instance uuid 5c368641-febc-420a-926d-929cb66d0ec6 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:42:57.995217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685fc311a8c14573b19719fb093e3ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b578ad7d48e406fabfc32450de322d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:58.010578 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b2e41533-7c51-4d52-bc92-be49574e332a tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 200 len: 1309 microversion: 2.1 time: 0.173513 Aug 24 15:42:58.013534 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 331/664] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:57 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:58.018386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-55a82de7-a158-4f38-ac6c-343d52f9c99f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209339 Aug 24 15:42:58.019020 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 334/665] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 15:42:57 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:58.809368 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:58.810580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:58.818385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:58.826481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:58.828174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:58.829199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:58.829903 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:58.830549 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:59.042194 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:59.043494 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] [instance: 5c368641-febc-420a-926d-929cb66d0ec6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:59.079344 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:59.080515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:59.082944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:59.083958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:59.084616 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:59.085211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:59.107471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] HTTP exception thrown: Instance 5c368641-febc-420a-926d-929cb66d0ec6 could not be found. Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Request method failure captured: Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 HTTP/1.1 Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkaPt2WmybeQXW6Eb-g1tWwmNCwei8246nao1CR0W80YEsTW1xZVrtVoRrxuV5UeZSNrrfymV3f0KsnOpRAf5knf4D06eEyXHLv33m3tA0_YtEgdwVJTcTBNJSG1GklmUVJviMuEu1XItumRl6tmjHrm1o4_wCo7nvFjPTRoXif3GY4 Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b578ad7d48e406fabfc32450de322d1 Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1246240646 Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:42:59.109322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b578ad7d48e406fabfc32450de322d1", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b578ad7d48e406fabfc32450de322d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b578ad7d48e406fabfc32450de322d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b578ad7d48e406fabfc32450de322d1"}]}] Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesSnapshotTestJSON-1246240646 Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b578ad7d48e406fabfc32450de322d1 Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1246240646 Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesSnapshotTestJSON-1246240646-project Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 685fc311a8c14573b19719fb093e3ee2 Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesSnapshotTestJSON-1246240646-project Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 5c368641-febc-420a-926d-929cb66d0ec6 could not be found. Aug 24 15:42:59.110941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '5c368641-febc-420a-926d-929cb66d0ec6'} Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c368641-febc-420a-926d-929cb66d0ec6 could not be found. Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:59.111849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c368641-febc-420a-926d-929cb66d0ec6 could not be found. Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c368641-febc-420a-926d-929cb66d0ec6 could not be found. Aug 24 15:42:59.113297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:42:59.115386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] Returning 404 to user: Instance 5c368641-febc-420a-926d-929cb66d0ec6 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:59.116410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-27965a79-9bdf-4fcf-a555-a7315fda41c5 tempest-VolumesSnapshotTestJSON-1246240646 tempest-VolumesSnapshotTestJSON-1246240646-project] 10.222.0.73 "GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6" status: 404 len: 111 microversion: 2.1 time: 0.082757 Aug 24 15:42:59.123071 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 335/666] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:59 2022] GET /compute/v2.1/servers/5c368641-febc-420a-926d-929cb66d0ec6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:59.254758 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:59.265473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:59.267262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:59.268554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6b834b40-d9f6-48db-8b83-bf7afa4506e7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1406 microversion: 2.20 time: 0.463148 Aug 24 15:42:59.279136 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 332/667] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:42:58 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:42:59.656661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-781dd218-aa43-4a86-b1c6-13159c251c8d req-4435c0c6-7523-471a-9c9f-62aba641673a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6562ed4a-9a9b-454e-a4fd-d0c2e7d19452", "tag": "d8aa5e82-99d7-4489-bc2f-7393036fdb8a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:59.661846 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=6 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:59.669007 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-781dd218-aa43-4a86-b1c6-13159c251c8d req-4435c0c6-7523-471a-9c9f-62aba641673a service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:59.669565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-781dd218-aa43-4a86-b1c6-13159c251c8d req-4435c0c6-7523-471a-9c9f-62aba641673a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:59.670109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-781dd218-aa43-4a86-b1c6-13159c251c8d req-4435c0c6-7523-471a-9c9f-62aba641673a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:59.681421 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-781dd218-aa43-4a86-b1c6-13159c251c8d req-4435c0c6-7523-471a-9c9f-62aba641673a service nova] Creating event network-changed:d8aa5e82-99d7-4489-bc2f-7393036fdb8a for instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 on hv-cinder-84605 Aug 24 15:42:59.687879 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-781dd218-aa43-4a86-b1c6-13159c251c8d req-4435c0c6-7523-471a-9c9f-62aba641673a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034820 Aug 24 15:42:59.688661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 336/668] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:59.882140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-7892ff9a-d0ce-4461-8991-6ba3696438a3 req-a443147c-af17-4070-87c1-39e8541831ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e5ba349-889b-48e9-a144-173d715cc532", "tag": "1f59ed6f-c2a7-4b96-887e-58d69156e466"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:59.894304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7892ff9a-d0ce-4461-8991-6ba3696438a3 req-a443147c-af17-4070-87c1-39e8541831ce service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:59.894948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7892ff9a-d0ce-4461-8991-6ba3696438a3 req-a443147c-af17-4070-87c1-39e8541831ce service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:59.895389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-7892ff9a-d0ce-4461-8991-6ba3696438a3 req-a443147c-af17-4070-87c1-39e8541831ce service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:59.907866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-7892ff9a-d0ce-4461-8991-6ba3696438a3 req-a443147c-af17-4070-87c1-39e8541831ce service nova] Creating event network-changed:1f59ed6f-c2a7-4b96-887e-58d69156e466 for instance 2e5ba349-889b-48e9-a144-173d715cc532 on hv-cinder-84605 Aug 24 15:42:59.913171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-7892ff9a-d0ce-4461-8991-6ba3696438a3 req-a443147c-af17-4070-87c1-39e8541831ce service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099654 Aug 24 15:42:59.914264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 333/669] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:00.294554 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:00.295284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:00.305534 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:00.306029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:00.306462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:00.307632 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:00.308389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:00.309789 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:00.819467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:00.830426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:00.832122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:00.833299 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-255786df-b7bd-43c9-a844-3957e3524366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1406 microversion: 2.20 time: 0.544543 Aug 24 15:43:00.833864 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 337/670] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:00 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1406 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:01.858162 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:01.859043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:01.866165 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:01.866734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:01.867121 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:01.867881 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:01.868321 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:01.868747 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:02.062191 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:02.070738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:02.072509 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:02.073813 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6d750af0-86db-4f1b-842b-7b2572a7b9ca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1406 microversion: 2.20 time: 0.220428 Aug 24 15:43:02.074488 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 334/671] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:01 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:03.099538 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:03.100835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:03.108444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:03.109025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:03.109522 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:03.110319 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:03.110876 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:03.111366 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:03.285555 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:03.296037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:03.310943 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:03.312515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3005afaf-7e00-4b5b-8b02-dcd23e09b1d3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1406 microversion: 2.20 time: 0.218832 Aug 24 15:43:03.327768 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 338/672] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:03 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:04.336683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:04.337949 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:04.345953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:04.348952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=8 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:04.357151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:04.357787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:04.358310 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:04.359161 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:04.359695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:04.360202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:04.587098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:04.597878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:04.599916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:04.601242 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3ed60ff0-079c-48b8-b9ae-8b1bfc8dbf18 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1406 microversion: 2.20 time: 0.268843 Aug 24 15:43:04.601806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 335/673] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:04 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:05.289673 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-ae47beb7-4fe3-46c6-9f33-fc492e859429 req-b14aa457-894f-415b-ab0b-013c84f83728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6562ed4a-9a9b-454e-a4fd-d0c2e7d19452", "name": "network-vif-plugged", "status": "completed", "tag": "d8aa5e82-99d7-4489-bc2f-7393036fdb8a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:05.300558 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ae47beb7-4fe3-46c6-9f33-fc492e859429 req-b14aa457-894f-415b-ab0b-013c84f83728 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:05.301409 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ae47beb7-4fe3-46c6-9f33-fc492e859429 req-b14aa457-894f-415b-ab0b-013c84f83728 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:05.301932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ae47beb7-4fe3-46c6-9f33-fc492e859429 req-b14aa457-894f-415b-ab0b-013c84f83728 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:05.316967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-ae47beb7-4fe3-46c6-9f33-fc492e859429 req-b14aa457-894f-415b-ab0b-013c84f83728 service nova] Creating event network-vif-plugged:d8aa5e82-99d7-4489-bc2f-7393036fdb8a for instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 on hv-cinder-84605 Aug 24 15:43:05.333573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-ae47beb7-4fe3-46c6-9f33-fc492e859429 req-b14aa457-894f-415b-ab0b-013c84f83728 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192683 Aug 24 15:43:05.334184 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 339/674] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:05.635523 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:05.637099 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:05.672444 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:05.674196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:05.674436 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:05.675188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:05.675646 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:05.676078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:05.753531 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:05.759480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:05.778455 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:05.778991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:05.786827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:05.787591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:05.788236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:05.788829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:05.839585 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d49d4721-edb7-44c4-931f-f1161f1a9795 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.093320 Aug 24 15:43:05.851449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 340/675] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:05 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:05.904237 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:05.912613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:05.914373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:05.915759 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6a9ca687-c0dc-4681-87c8-23333b7bf329 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1406 microversion: 2.20 time: 0.290049 Aug 24 15:43:05.916674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 336/676] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:05 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:05.986998 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:05.987928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:05.993754 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:05.994245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:05.994715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:05.996652 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:05.997152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:05.997617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:06.042425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7cce03cd-58a2-482f-b1bd-c932c33a6a8a tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/50451e92-a7fd-4996-86ad-bee5c9e4215a" status: 200 len: 194 microversion: 2.1 time: 0.059391 Aug 24 15:43:06.047052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 341/677] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 15:43:05 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/50451e92-a7fd-4996-86ad-bee5c9e4215a => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:06.054693 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:06.055537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:06.057452 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:06.063850 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:06.064349 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:06.064993 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:06.065939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:06.066400 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:06.067054 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:06.164977 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lazy-loading 'services' on Instance uuid c8d2a085-4e03-4b66-9095-5c934d177719 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:43:06.243524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:06.262031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a6619d54-ca88-46f2-b956-884acdcf01d8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/50451e92-a7fd-4996-86ad-bee5c9e4215a" status: 202 len: 0 microversion: 2.1 time: 0.211425 Aug 24 15:43:06.264080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 337/678] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:43:06 2022] DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/50451e92-a7fd-4996-86ad-bee5c9e4215a => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:43:06.940540 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:06.941775 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:06.949197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:06.950237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:06.951063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:06.952017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:06.952695 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:06.953365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:07.201083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:07.210909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:07.212495 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:07.214046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f7baa343-59e0-4041-9eb4-07f113e429a2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1406 microversion: 2.20 time: 0.277194 Aug 24 15:43:07.231107 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 342/679] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:06 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:08.239754 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:08.241129 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:08.249181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.249907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.250342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.251258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.251714 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.252141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.508903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:08.509692 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:08.519432 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.520579 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.521232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.522614 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.523640 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.524280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.554814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:08.574497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:08.582008 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:08.589252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-52f9ef21-7d4d-4b87-8192-d5e97e322b55 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1598 microversion: 2.20 time: 0.354300 Aug 24 15:43:08.591322 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 338/680] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:08 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1598 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:08.601072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-32de71d8-d4d8-4c38-a187-ea0e8f1356c7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/e50f6757-6d35-4d99-b01d-577ba3acf727" status: 200 len: 194 microversion: 2.1 time: 0.097739 Aug 24 15:43:08.609221 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 343/681] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 15:43:08 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/e50f6757-6d35-4d99-b01d-577ba3acf727 => generated 194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:08.617574 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:08.618377 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:08.621372 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:08.622068 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:08.625177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.625953 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.626849 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.627751 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.628392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.629838 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.645560 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.647078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.647535 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.648701 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:08.651907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:08.655617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:08.799634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lazy-loading 'services' on Instance uuid c8d2a085-4e03-4b66-9095-5c934d177719 {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:43:08.802835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:08.865680 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6b009226-1dcd-4859-9939-62b2f7771717 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.256061 Aug 24 15:43:08.866285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 339/682] 10.222.0.73 () {60 vars in 1316 bytes} [Wed Aug 24 15:43:08 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-interface => generated 285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:43:08.943441 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-363ff323-df60-4bec-b7bf-1b6c428a011d tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/e50f6757-6d35-4d99-b01d-577ba3acf727" status: 202 len: 0 microversion: 2.1 time: 0.330409 Aug 24 15:43:08.944395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 344/683] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:43:08 2022] DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments/e50f6757-6d35-4d99-b01d-577ba3acf727 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:43:10.323254 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-c78b2377-41a1-4e95-ad2d-8ebb7286c6bc req-c5786686-0d84-46ac-9d3e-296050aef02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6562ed4a-9a9b-454e-a4fd-d0c2e7d19452", "tag": "d8aa5e82-99d7-4489-bc2f-7393036fdb8a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:10.340785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c78b2377-41a1-4e95-ad2d-8ebb7286c6bc req-c5786686-0d84-46ac-9d3e-296050aef02c service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:10.341208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c78b2377-41a1-4e95-ad2d-8ebb7286c6bc req-c5786686-0d84-46ac-9d3e-296050aef02c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:10.341643 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-c78b2377-41a1-4e95-ad2d-8ebb7286c6bc req-c5786686-0d84-46ac-9d3e-296050aef02c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:10.366579 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-c78b2377-41a1-4e95-ad2d-8ebb7286c6bc req-c5786686-0d84-46ac-9d3e-296050aef02c service nova] Creating event network-changed:d8aa5e82-99d7-4489-bc2f-7393036fdb8a for instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 on hv-cinder-84605 Aug 24 15:43:10.378796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-c78b2377-41a1-4e95-ad2d-8ebb7286c6bc req-c5786686-0d84-46ac-9d3e-296050aef02c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059824 Aug 24 15:43:10.379765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 340/684] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:12.485301 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:12.492615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:12.505591 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:12.506328 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:12.507760 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:12.509865 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:12.511471 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:12.512135 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:12.520806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a27703b9-29d6-459b-a15f-2145705114a5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Action: 'create', calling method: .version_select at 0x7f07906b38b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-292842636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc1XH+gLUyN9ByLWGALgtB8p6DcCUx3W0bjy27VKbnKissi5CRuQpCELrJTPu5Yee3FNnHf5zg6l6mqqGPe805vFrdKkm4dCGFHqAIk+R3tM6MElik+WEXd5MMHmA6bZg=="}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:12.542494 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-a27703b9-29d6-459b-a15f-2145705114a5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for project b496441965834f65a8d0813e8221c685. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:43:12.547683 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-a27703b9-29d6-459b-a15f-2145705114a5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for user 81be4c83d3b04624ae11bcbf37a44309 and project b496441965834f65a8d0813e8221c685. Resources: {'key_pairs'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:43:12.563031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-14e97419-637e-4f34-a2c6-adff15276303 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084570 Aug 24 15:43:12.572457 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 341/685] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:12 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:43:12.584126 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a27703b9-29d6-459b-a15f-2145705114a5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.381797 Aug 24 15:43:12.584803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 345/686] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:43:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:12.700587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:12.702690 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:12.709012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:12.709493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:12.710224 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:12.711078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:12.712321 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:12.712655 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:12.747785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d59891e7-76d3-4c95-bbee-ab073bfdf682 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052196 Aug 24 15:43:12.748361 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 342/687] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:12 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:43:12.820960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:12.821578 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:12.829061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:12.829556 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:12.829991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:12.830708 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:12.831157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:12.831576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:12.860680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:43:12.980506 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7761a6ac-e4cb-4f14-88d3-69f61eb3165e tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 204 len: 0 microversion: 2.1 time: 0.162447 Aug 24 15:43:12.981510 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 346/688] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:43:12 2022] DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:12.990266 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:12.991072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:12.999471 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:13.000063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:13.000607 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:13.001364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:13.001809 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:13.002324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:13.220795 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:13.234766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b35d3259-b2cd-44bc-85b2-50a7cbaea101 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1673 microversion: 2.1 time: 0.248574 Aug 24 15:43:13.237151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 343/689] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:12 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:14.258858 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:14.259476 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:14.272030 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:14.272747 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:14.275142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:14.277689 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:14.278772 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:14.279802 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:14.424515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:14.436201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-69260cdf-59bc-4005-9fdf-6d67682f319c tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1673 microversion: 2.1 time: 0.182175 Aug 24 15:43:14.437790 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 347/690] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:14 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:15.460738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:15.461362 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:15.468742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:15.469223 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:15.469649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:15.470339 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:15.471165 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:15.471743 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:15.622396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f28236459bb9492eaa35690f121d4e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f176b3cafe45d497dee2f1d031a4ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:15.632193 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3c665100-c25e-49e9-867f-ad3238c21dc8 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 200 len: 1673 microversion: 2.1 time: 0.175299 Aug 24 15:43:15.632773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 344/691] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:15 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:16.051352 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-bcc9c0a9-95e7-4774-80b3-31830d366e21 req-d953ad4a-75d5-4b4c-a73f-557519110fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d2a085-4e03-4b66-9095-5c934d177719", "name": "network-vif-deleted", "tag": "0c3944b5-6421-49fd-b1b0-a42f4ca0afa6"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:16.062463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:16.067968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-bcc9c0a9-95e7-4774-80b3-31830d366e21 req-d953ad4a-75d5-4b4c-a73f-557519110fcc service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:16.068728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-bcc9c0a9-95e7-4774-80b3-31830d366e21 req-d953ad4a-75d5-4b4c-a73f-557519110fcc service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:16.069364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-bcc9c0a9-95e7-4774-80b3-31830d366e21 req-d953ad4a-75d5-4b4c-a73f-557519110fcc service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:16.106935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-bcc9c0a9-95e7-4774-80b3-31830d366e21 req-d953ad4a-75d5-4b4c-a73f-557519110fcc service nova] Creating event network-vif-deleted:0c3944b5-6421-49fd-b1b0-a42f4ca0afa6 for instance c8d2a085-4e03-4b66-9095-5c934d177719 on hv-cinder-84605 Aug 24 15:43:16.113209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-bcc9c0a9-95e7-4774-80b3-31830d366e21 req-d953ad4a-75d5-4b4c-a73f-557519110fcc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071111 Aug 24 15:43:16.114791 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 348/692] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:16.658737 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:16.673152 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:16.694664 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:16.695511 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:16.696705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:16.698951 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:16.700320 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:16.700929 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:16.723786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] HTTP exception thrown: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Request method failure captured: Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 HTTP/1.1 Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW2XSzmsRO_ta9JvEa5KW3vpaXuNJQT6m2Awg5TEAu9oNyPXTETBq5iR1b8k4cC8Qmezzvyn1cAuzI1iSe6TdhsNkhIo7q4yqa2lviJVA3aOuHgrSQTHyRDz-prVxSLnUU9bWUYzZWbypMEjJbRACvYynwkYDu-66y-xwHiWUF4kl8 Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:16.726376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98f176b3cafe45d497dee2f1d031a4ec", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98f176b3cafe45d497dee2f1d031a4ec"}]}] Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: f28236459bb9492eaa35690f121d4e3c Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:16.727822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'c8d2a085-4e03-4b66-9095-5c934d177719'} Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:16.728639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:16.732013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:16.733971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Returning 404 to user: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:16.733971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6bad54f8-0b1f-4751-9efc-433a89df4060 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 404 len: 111 microversion: 2.1 time: 0.075636 Aug 24 15:43:16.733971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 345/693] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:16 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:43:16.740602 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-690f6bd1-21fc-4264-b305-48139058d01f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '.version_select at 0x7f07905d9790>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:16.789295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-690f6bd1-21fc-4264-b305-48139058d01f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025421860" status: 202 len: 0 microversion: 2.1 time: 0.053384 Aug 24 15:43:16.790112 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 349/694] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 15:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025421860 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:43:19.828615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:19.829188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:19.835828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:19.836312 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:19.836736 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:19.838055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:19.838514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:19.838966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:19.852341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] HTTP exception thrown: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Request method failure captured: Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 HTTP/1.1 Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW2XSzmsRO_ta9JvEa5KW3vpaXuNJQT6m2Awg5TEAu9oNyPXTETBq5iR1b8k4cC8Qmezzvyn1cAuzI1iSe6TdhsNkhIo7q4yqa2lviJVA3aOuHgrSQTHyRDz-prVxSLnUU9bWUYzZWbypMEjJbRACvYynwkYDu-66y-xwHiWUF4kl8 Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:19.854079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98f176b3cafe45d497dee2f1d031a4ec", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98f176b3cafe45d497dee2f1d031a4ec"}]}] Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: f28236459bb9492eaa35690f121d4e3c Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.856012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'c8d2a085-4e03-4b66-9095-5c934d177719'} Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:19.856868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.858060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.859567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Returning 404 to user: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:19.859567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-df1145d7-96f1-4fb2-a44a-e197d825c217 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 404 len: 111 microversion: 2.1 time: 0.031060 Aug 24 15:43:19.859567 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 346/695] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:43:19 2022] DELETE /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:43:19.865444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:19.866241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: c8d2a085-4e03-4b66-9095-5c934d177719] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:19.873436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:19.873920 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:19.874354 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:19.875074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:19.875530 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:19.875951 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:19.891593 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] HTTP exception thrown: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Request method failure captured: Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 HTTP/1.1 Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW2XSzmsRO_ta9JvEa5KW3vpaXuNJQT6m2Awg5TEAu9oNyPXTETBq5iR1b8k4cC8Qmezzvyn1cAuzI1iSe6TdhsNkhIo7q4yqa2lviJVA3aOuHgrSQTHyRDz-prVxSLnUU9bWUYzZWbypMEjJbRACvYynwkYDu-66y-xwHiWUF4kl8 Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:43:19.893210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98f176b3cafe45d497dee2f1d031a4ec", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98f176b3cafe45d497dee2f1d031a4ec"}]}] Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: f28236459bb9492eaa35690f121d4e3c Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.894750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'c8d2a085-4e03-4b66-9095-5c934d177719'} Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:19.895622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. Aug 24 15:43:19.897046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:19.898395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Returning 404 to user: Instance c8d2a085-4e03-4b66-9095-5c934d177719 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:19.898395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c74748c6-2244-4636-8e11-f53260bfdac0 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719" status: 404 len: 111 microversion: 2.1 time: 0.034190 Aug 24 15:43:19.898395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 350/696] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:19 2022] GET /compute/v2.1/servers/c8d2a085-4e03-4b66-9095-5c934d177719 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:43:21.037080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:21.037617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:21.044308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:21.044801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:21.045238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:21.045949 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:21.046404 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:21.046869 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:21.061149 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] HTTP exception thrown: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Request method failure captured: Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: DELETE /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 HTTP/1.1 Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW2XSzmsRO_ta9JvEa5KW3vpaXuNJQT6m2Awg5TEAu9oNyPXTETBq5iR1b8k4cC8Qmezzvyn1cAuzI1iSe6TdhsNkhIo7q4yqa2lviJVA3aOuHgrSQTHyRDz-prVxSLnUU9bWUYzZWbypMEjJbRACvYynwkYDu-66y-xwHiWUF4kl8 Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:21.062783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98f176b3cafe45d497dee2f1d031a4ec", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98f176b3cafe45d497dee2f1d031a4ec"}]}] Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: f28236459bb9492eaa35690f121d4e3c Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.064329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '905f49ec-5f2b-4a83-994b-8d36385a9996'} Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:21.065806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.069062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.070893 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Returning 404 to user: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:21.070893 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a351cade-5252-4083-97ab-d3235919cc4f tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "DELETE /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 404 len: 111 microversion: 2.1 time: 0.030970 Aug 24 15:43:21.070893 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 347/697] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:43:21 2022] DELETE /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:43:21.073347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:21.073962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] [instance: 905f49ec-5f2b-4a83-994b-8d36385a9996] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:21.080436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:21.080927 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:21.081372 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:21.082065 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:21.082523 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:21.082987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:21.097139 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] HTTP exception thrown: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Request method failure captured: Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 HTTP/1.1 Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW2XSzmsRO_ta9JvEa5KW3vpaXuNJQT6m2Awg5TEAu9oNyPXTETBq5iR1b8k4cC8Qmezzvyn1cAuzI1iSe6TdhsNkhIo7q4yqa2lviJVA3aOuHgrSQTHyRDz-prVxSLnUU9bWUYzZWbypMEjJbRACvYynwkYDu-66y-xwHiWUF4kl8 Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:43:21.098678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98f176b3cafe45d497dee2f1d031a4ec", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98f176b3cafe45d497dee2f1d031a4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98f176b3cafe45d497dee2f1d031a4ec"}]}] Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 98f176b3cafe45d497dee2f1d031a4ec Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1835078496 Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: f28236459bb9492eaa35690f121d4e3c Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeTestJSON-1835078496-project Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.100346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '905f49ec-5f2b-4a83-994b-8d36385a9996'} Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:21.101209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. Aug 24 15:43:21.102664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:21.103946 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] Returning 404 to user: Instance 905f49ec-5f2b-4a83-994b-8d36385a9996 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:21.103946 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9ef2cdc1-c294-4cfe-8dc6-8e17f7c5e1f7 tempest-AttachVolumeTestJSON-1835078496 tempest-AttachVolumeTestJSON-1835078496-project] 10.222.0.73 "GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996" status: 404 len: 111 microversion: 2.1 time: 0.031220 Aug 24 15:43:21.107392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 351/698] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:21 2022] GET /compute/v2.1/servers/905f49ec-5f2b-4a83-994b-8d36385a9996 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:43:26.072511 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-be6b7c5c-e3f3-43c5-84f1-197833a5fbcd tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Action: 'create', calling method: .version_select at 0x7f07836a5820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-982512683", "metadata": {"Type": "work"}}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-be6b7c5c-e3f3-43c5-84f1-197833a5fbcd tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Request method failure captured: Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 121 Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkcdZLmuEhAtNZbHFyNhWLBGj-Wu7i11qXmOsHBtQDtogMzH6ptf1Kn3au74F2srMQlpzkqzuhz_4Ym4SJjq8lxHli05W8XGctkljDHpFI2A6LyC36kFL_DpOdGMAf4leymsQFAoGeTjOZsJShDV3YDQ48Dzo1jzJUIOlr0GPpUaCuw Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:26.087423 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_07324840b7904c2c8c66a14f0c24b541", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/07324840b7904c2c8c66a14f0c24b541"}]}] Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: ad5a304405e6443dbfca71581d719189 Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-982512683", "metadata": {"Type": "work"}}} Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: Aug 24 15:43:26.089801 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-982512683', 'metadata': {'Type': 'work'}}}} Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:26.092596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:43:26.094042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:43:26.096784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:43:26.096784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.096784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-be6b7c5c-e3f3-43c5-84f1-197833a5fbcd tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:26.096784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-be6b7c5c-e3f3-43c5-84f1-197833a5fbcd tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179658 Aug 24 15:43:26.096784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 348/699] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 15:43:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 15:43:26.105823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3eb07913-022a-4d6e-a152-5be8fd063f56 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Action: 'create', calling method: .version_select at 0x7f07906253a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1666696010", "metadata": {"Type": "work"}}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3eb07913-022a-4d6e-a152-5be8fd063f56 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Request method failure captured: Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 120 Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkcdZLmuEhAtNZbHFyNhWLBGj-Wu7i11qXmOsHBtQDtogMzH6ptf1Kn3au74F2srMQlpzkqzuhz_4Ym4SJjq8lxHli05W8XGctkljDHpFI2A6LyC36kFL_DpOdGMAf4leymsQFAoGeTjOZsJShDV3YDQ48Dzo1jzJUIOlr0GPpUaCuw Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:43:26.110478 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_07324840b7904c2c8c66a14f0c24b541", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/07324840b7904c2c8c66a14f0c24b541"}]}] Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: ad5a304405e6443dbfca71581d719189 Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1666696010", "metadata": {"Type": "work"}}} Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: Aug 24 15:43:26.111935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1666696010', 'metadata': {'Type': 'work'}}}} Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi '0' Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:26.112763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:43:26.114728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:43:26.116019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:43:26.116019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.116019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3eb07913-022a-4d6e-a152-5be8fd063f56 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:26.116019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3eb07913-022a-4d6e-a152-5be8fd063f56 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013154 Aug 24 15:43:26.116019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 352/700] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 15:43:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:43:26.124370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a238178f-9729-4674-94da-12f141ce1da4 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Action: 'create', calling method: .version_select at 0x7f0783438280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1982306260", "metadata": {"Type": "work"}}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a238178f-9729-4674-94da-12f141ce1da4 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Request method failure captured: Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 119 Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkcdZLmuEhAtNZbHFyNhWLBGj-Wu7i11qXmOsHBtQDtogMzH6ptf1Kn3au74F2srMQlpzkqzuhz_4Ym4SJjq8lxHli05W8XGctkljDHpFI2A6LyC36kFL_DpOdGMAf4leymsQFAoGeTjOZsJShDV3YDQ48Dzo1jzJUIOlr0GPpUaCuw Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:26.130063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_07324840b7904c2c8c66a14f0c24b541", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/07324840b7904c2c8c66a14f0c24b541"}]}] Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: ad5a304405e6443dbfca71581d719189 Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1982306260", "metadata": {"Type": "work"}}} Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: Aug 24 15:43:26.131724 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1982306260', 'metadata': {'Type': 'work'}}}} Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi '' Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:26.132662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:43:26.135502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:43:26.136864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:43:26.136864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.136864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a238178f-9729-4674-94da-12f141ce1da4 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:26.136864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a238178f-9729-4674-94da-12f141ce1da4 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012138 Aug 24 15:43:26.136864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 349/701] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 15:43:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 15:43:26.140856 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=4 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:26.144935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-62f7e875-9d2a-4765-a188-ed429d8c7fc7 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Calling method '.version_select at 0x7f0790585790>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:26.174881 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-62f7e875-9d2a-4765-a188-ed429d8c7fc7 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] HTTP exception thrown: Volume tempest-invalid-64566505 could not be found. Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-62f7e875-9d2a-4765-a188-ed429d8c7fc7 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Request method failure captured: Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-64566505 HTTP/1.1 Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkcdZLmuEhAtNZbHFyNhWLBGj-Wu7i11qXmOsHBtQDtogMzH6ptf1Kn3au74F2srMQlpzkqzuhz_4Ym4SJjq8lxHli05W8XGctkljDHpFI2A6LyC36kFL_DpOdGMAf4leymsQFAoGeTjOZsJShDV3YDQ48Dzo1jzJUIOlr0GPpUaCuw Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:43:26.176884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_07324840b7904c2c8c66a14f0c24b541", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/07324840b7904c2c8c66a14f0c24b541"}]}] Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: ad5a304405e6443dbfca71581d719189 Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Volume tempest-invalid-64566505 could not be found. Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'tempest-invalid-64566505'} Aug 24 15:43:26.178439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-64566505 could not be found. (HTTP 404) (Request-ID: req-6d27672a-5f54-4c5f-81ef-d8288571a5db) Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.179445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:43:26.181691 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-64566505 could not be found. Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:26.184345 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-64566505 could not be found. Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-64566505 could not be found. Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-62f7e875-9d2a-4765-a188-ed429d8c7fc7 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Returning 404 to user: Volume tempest-invalid-64566505 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:26.185884 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-62f7e875-9d2a-4765-a188-ed429d8c7fc7 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-64566505" status: 404 len: 97 microversion: 2.1 time: 0.038783 Aug 24 15:43:26.186857 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 353/702] 10.222.0.73 () {58 vars in 1212 bytes} [Wed Aug 24 15:43:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-64566505 => generated 97 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:43:26.191965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fecb83c8-602c-4a5d-ae45-13ef796de96b tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004397 Aug 24 15:43:26.192473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 350/703] 10.222.0.73 () {58 vars in 1140 bytes} [Wed Aug 24 15:43:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 15:43:26.202457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f45ae12f-637b-4215-9fb9-45dc03810a65 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004281 Aug 24 15:43:26.203146 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 354/704] 10.222.0.73 () {58 vars in 1137 bytes} [Wed Aug 24 15:43:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 15:43:26.212986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6860aa51-c534-4feb-b36d-fc1e78c0bf8a tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Calling method '.version_select at 0x7f07834bbee0>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:26.246910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-6860aa51-c534-4feb-b36d-fc1e78c0bf8a tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] HTTP exception thrown: Volume 62550ad5-fdce-4d83-93ac-07f4bac28fee could not be found. Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6860aa51-c534-4feb-b36d-fc1e78c0bf8a tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Request method failure captured: Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: DELETE /compute/v2.1/os-volumes/62550ad5-fdce-4d83-93ac-07f4bac28fee HTTP/1.1 Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkcdZLmuEhAtNZbHFyNhWLBGj-Wu7i11qXmOsHBtQDtogMzH6ptf1Kn3au74F2srMQlpzkqzuhz_4Ym4SJjq8lxHli05W8XGctkljDHpFI2A6LyC36kFL_DpOdGMAf4leymsQFAoGeTjOZsJShDV3YDQ48Dzo1jzJUIOlr0GPpUaCuw Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:26.248836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_07324840b7904c2c8c66a14f0c24b541", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/07324840b7904c2c8c66a14f0c24b541"}]}] Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: ad5a304405e6443dbfca71581d719189 Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Volume 62550ad5-fdce-4d83-93ac-07f4bac28fee could not be found. Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '62550ad5-fdce-4d83-93ac-07f4bac28fee'} Aug 24 15:43:26.250447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 62550ad5-fdce-4d83-93ac-07f4bac28fee could not be found. (HTTP 404) (Request-ID: req-489dc8fd-757e-419e-a9a7-b9dee258f45c) Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.255627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:43:26.257005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 62550ad5-fdce-4d83-93ac-07f4bac28fee could not be found. Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:43:26.258403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 62550ad5-fdce-4d83-93ac-07f4bac28fee could not be found. Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 62550ad5-fdce-4d83-93ac-07f4bac28fee could not be found. Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6860aa51-c534-4feb-b36d-fc1e78c0bf8a tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Returning 404 to user: Volume 62550ad5-fdce-4d83-93ac-07f4bac28fee could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6860aa51-c534-4feb-b36d-fc1e78c0bf8a tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/62550ad5-fdce-4d83-93ac-07f4bac28fee" status: 404 len: 109 microversion: 2.1 time: 0.041409 Aug 24 15:43:26.260326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 351/705] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:43:26 2022] DELETE /compute/v2.1/os-volumes/62550ad5-fdce-4d83-93ac-07f4bac28fee => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:43:26.267729 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f29ccaf7-41af-44f3-bbe4-3afd40442f04 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Calling method '.version_select at 0x7f0790625af0>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:26.305318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-f29ccaf7-41af-44f3-bbe4-3afd40442f04 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] HTTP exception thrown: Volume bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 could not be found. Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f29ccaf7-41af-44f3-bbe4-3afd40442f04 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Request method failure captured: Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/os-volumes/bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 HTTP/1.1 Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkcdZLmuEhAtNZbHFyNhWLBGj-Wu7i11qXmOsHBtQDtogMzH6ptf1Kn3au74F2srMQlpzkqzuhz_4Ym4SJjq8lxHli05W8XGctkljDHpFI2A6LyC36kFL_DpOdGMAf4leymsQFAoGeTjOZsJShDV3YDQ48Dzo1jzJUIOlr0GPpUaCuw Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:43:26.307942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_07324840b7904c2c8c66a14f0c24b541", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/07324840b7904c2c8c66a14f0c24b541"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/07324840b7904c2c8c66a14f0c24b541"}]}] Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 07324840b7904c2c8c66a14f0c24b541 Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-VolumesNegativeTest-1829957701 Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: ad5a304405e6443dbfca71581d719189 Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-VolumesNegativeTest-1829957701-project Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Volume bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 could not be found. Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'bb5aef49-2ad2-456a-a98b-2fbaeebecdd8'} Aug 24 15:43:26.309512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 could not be found. (HTTP 404) (Request-ID: req-3bf32989-098e-4d3b-a08b-e9e0e496fa56) Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.310597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:43:26.312013 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 could not be found. Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:43:26.313398 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 could not be found. Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 could not be found. Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f29ccaf7-41af-44f3-bbe4-3afd40442f04 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] Returning 404 to user: Volume bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f29ccaf7-41af-44f3-bbe4-3afd40442f04 tempest-VolumesNegativeTest-1829957701 tempest-VolumesNegativeTest-1829957701-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/bb5aef49-2ad2-456a-a98b-2fbaeebecdd8" status: 404 len: 109 microversion: 2.1 time: 0.045790 Aug 24 15:43:26.314715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 355/706] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:43:26 2022] GET /compute/v2.1/os-volumes/bb5aef49-2ad2-456a-a98b-2fbaeebecdd8 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:43:30.477334 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1286034022", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-292842636", "security_groups": [{"name": "tempest-secgroup-smoke-514253164"}], "block_device_mapping_v2": [{"uuid": "7627d83d-173b-4e73-a422-99f87326bb99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55e08d2e-d6cb-4529-86e4-566ae8e28cc6"}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:30.657765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] validate_networks() for [('55e08d2e-d6cb-4529-86e4-566ae8e28cc6', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:43:31.051958 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=42 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.227994 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:43:31.228456 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:43:31.228939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:43:31.229617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:43:31.230030 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:43:31.240273 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:31.240760 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:31.241192 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:31.242309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:31.242879 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:31.243703 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:31.263217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for project b496441965834f65a8d0813e8221c685. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:43:31.267621 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for user 81be4c83d3b04624ae11bcbf37a44309 and project b496441965834f65a8d0813e8221c685. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:43:31.352764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:43:31.355697 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7627d83d-173b-4e73-a422-99f87326bb99',volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:43:31.516670 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-34a10373-478f-4bd3-af8b-3cfab38961b4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.044984 Aug 24 15:43:31.523648 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 352/707] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:43:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:43:31.526493 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.527535 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:31.532352 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a75b54bc-9c92-45fc-acb8-222198d2ded5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:31.535203 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a75b54bc-9c92-45fc-acb8-222198d2ded5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:31.616533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a75b54bc-9c92-45fc-acb8-222198d2ded5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:31.624995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a75b54bc-9c92-45fc-acb8-222198d2ded5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1094 microversion: 2.1 time: 0.100412 Aug 24 15:43:31.626030 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 356/708] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:31 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:32.648918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:32.651248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:32.665137 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:32.667291 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:32.667917 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:32.669530 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:32.671255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:32.675795 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:32.859147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:32.883473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1be758cd-7b0e-4687-91c0-0bf7c16288f7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1192 microversion: 2.1 time: 0.237775 Aug 24 15:43:32.896436 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 353/709] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:32 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1192 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:33.912753 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:33.913365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:33.923946 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:33.925055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:33.926380 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:33.929241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:33.934099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:33.934554 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:34.035486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:34.046533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f4c5b9ea-fc21-433a-952b-99b3eaa95263 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1198 microversion: 2.1 time: 0.139731 Aug 24 15:43:34.054099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 357/710] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:33 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1198 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:35.080332 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:35.082198 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:35.092256 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:35.098258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:35.099201 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:35.100102 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:35.100774 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:35.101350 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:35.372159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:35.392103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9e664c40-a429-4a90-8b22-32c8fd9aceb8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.318418 Aug 24 15:43:35.395267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 354/711] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:35 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:36.423186 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:36.424941 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:36.433661 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:36.434115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:36.434541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:36.436099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:36.437114 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:36.437595 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:36.702555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-8f11b950-1c1a-4e68-98c9-fa53d10e3868 req-1a4b8263-1093-4628-97a9-e08c3a9e24b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2939b24d-ed1a-4b5f-85c7-ba39b537afd2", "tag": "f082148e-fa4f-49a1-806d-e56c40305abb"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:36.716888 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:36.744406 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-8f11b950-1c1a-4e68-98c9-fa53d10e3868 req-1a4b8263-1093-4628-97a9-e08c3a9e24b4 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:36.745867 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-8f11b950-1c1a-4e68-98c9-fa53d10e3868 req-1a4b8263-1093-4628-97a9-e08c3a9e24b4 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:36.747303 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-8f11b950-1c1a-4e68-98c9-fa53d10e3868 req-1a4b8263-1093-4628-97a9-e08c3a9e24b4 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:36.765107 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-8f11b950-1c1a-4e68-98c9-fa53d10e3868 req-1a4b8263-1093-4628-97a9-e08c3a9e24b4 service nova] Creating event network-changed:f082148e-fa4f-49a1-806d-e56c40305abb for instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 on hv-cinder-84605 Aug 24 15:43:36.772678 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-8f11b950-1c1a-4e68-98c9-fa53d10e3868 req-1a4b8263-1093-4628-97a9-e08c3a9e24b4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083698 Aug 24 15:43:36.773852 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 355/712] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:36.958290 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:36.971480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a7fdb63f-35bc-496d-8c2d-c9b8596b8eb3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.553940 Aug 24 15:43:36.972113 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 358/713] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:36 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:37.936073 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9c2e607d-8550-4175-93a0-a4b18ef2f61f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Action: 'create', calling method: .version_select at 0x7f07833c3b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1038709999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHyqSA8H6+1Ej9NVXulni37Gm51FwuQSnrzfJ7ljr+jb2Xeujo7ImuWh+cFk6iYJqXjBpE2JfO0BE7A9OkvU3FW6wEosbAFOHqmY48sWn34Yqc0IiuEKAuFmb4Hm+8t2g=="}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:37.952892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-9c2e607d-8550-4175-93a0-a4b18ef2f61f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Getting quotas for project 3760b78ba8584e6c81c46d48113fcd45. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:43:37.957068 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-9c2e607d-8550-4175-93a0-a4b18ef2f61f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Getting quotas for user 90be4ab702e14f4387b0883dead72d9f and project 3760b78ba8584e6c81c46d48113fcd45. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:43:37.985005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9c2e607d-8550-4175-93a0-a4b18ef2f61f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.260482 Aug 24 15:43:37.986211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 356/714] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 15:43:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:37.995949 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:37.997105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:38.004079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:38.004665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:38.005189 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:38.005974 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:38.006504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:38.007041 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:38.244445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:38.257835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8ab93c30-5cca-48be-be53-06a7d3eadb8d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.266570 Aug 24 15:43:38.259144 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 359/715] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:37 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:39.285129 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:39.286723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:39.313107 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:39.313972 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:39.316589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:39.317379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:39.317986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:39.318626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:39.497625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:39.508504 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-29ba45a8-37d5-4d84-9fe4-a94580e56a99 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.228605 Aug 24 15:43:39.512627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 357/716] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:39 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:40.534227 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:40.534879 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:40.541275 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:40.541767 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:40.542196 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:40.542916 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:40.543372 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:40.543796 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:40.688819 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:40.697554 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0991698f-35a1-4926-8df5-1681469e5765 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.167306 Aug 24 15:43:40.698146 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 360/717] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:40 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:41.718962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:41.719575 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:41.723366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:41.729181 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:41.729666 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:41.730101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:41.730836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:41.731325 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:41.731742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:41.870986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:41.879865 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4a15d3af-e15a-4403-bd1f-99143569730b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.164764 Aug 24 15:43:41.880486 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 358/718] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:41 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:42.901159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:42.901767 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:42.904103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:42.909498 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:42.910004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:42.910443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:42.911195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:42.911650 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:42.912070 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:43.061291 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:43.069189 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-deb6b595-8738-40ad-abd8-04c092c5d25e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.172090 Aug 24 15:43:43.069832 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 361/719] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:42 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:43.861347 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:43.861900 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:43.869116 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:43.869601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:43.870046 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:43.870774 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:43.871235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:43.871661 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:43.895505 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4d6eb268-19b4-4106-b98c-d5b33882714b tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/ips" status: 200 len: 149 microversion: 2.1 time: 0.037894 Aug 24 15:43:43.897189 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 359/720] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:43:43 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:44.107594 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:44.108352 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:44.123411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:44.123902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:44.124336 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:44.125040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:44.125493 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:44.125917 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:44.278998 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:44.287040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2eaa6137-5d65-4ba5-9004-0f1e18cbd17e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.190535 Aug 24 15:43:44.287601 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 362/721] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:44 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:45.248568 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e86ff130-0088-4486-ae5d-bf447c9e6e87"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:45.250984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:45.258815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:45.259355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:45.259786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:45.260487 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:45.260937 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:45.261408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:45.308318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:45.308926 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:45.316159 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:45.316871 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:45.317309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:45.318143 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:45.318602 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:45.319052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:45.470327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:45.479586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7462705b-f7b8-4705-b28e-d4670f58e88e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.175632 Aug 24 15:43:45.480163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 363/722] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:45 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:45.527307 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-07141bf3-0b3d-4898-99f0-9b58f35dd39f tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "POST /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282634 Aug 24 15:43:45.528332 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 360/723] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 15:43:45 2022] POST /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:46.501221 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:46.501829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:46.508935 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:46.509462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:46.510102 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:46.510829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:46.511272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:46.511687 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:46.663851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:46.673319 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-53765804-56ad-46d7-b3f1-42b8bbefdcc5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.175730 Aug 24 15:43:46.674002 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 364/724] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:46 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:47.695174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:47.695874 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:47.703566 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:47.704157 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:47.704649 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:47.705354 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:47.705813 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:47.706267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:47.841556 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:47.849262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9bd1ce91-d861-474f-8c91-e046dcebadb1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.158278 Aug 24 15:43:47.849862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 361/725] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:47 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:48.011863 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-164b7e29-4557-485e-8efb-260aea3de054 req-bef175db-0aea-40d8-bfc8-e5d0e27f07d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2939b24d-ed1a-4b5f-85c7-ba39b537afd2", "name": "network-vif-plugged", "status": "completed", "tag": "f082148e-fa4f-49a1-806d-e56c40305abb"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:48.024087 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-164b7e29-4557-485e-8efb-260aea3de054 req-bef175db-0aea-40d8-bfc8-e5d0e27f07d8 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:48.024515 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-164b7e29-4557-485e-8efb-260aea3de054 req-bef175db-0aea-40d8-bfc8-e5d0e27f07d8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:48.025114 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-164b7e29-4557-485e-8efb-260aea3de054 req-bef175db-0aea-40d8-bfc8-e5d0e27f07d8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:48.037210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-164b7e29-4557-485e-8efb-260aea3de054 req-bef175db-0aea-40d8-bfc8-e5d0e27f07d8 service nova] Creating event network-vif-plugged:f082148e-fa4f-49a1-806d-e56c40305abb for instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 on hv-cinder-84605 Aug 24 15:43:48.042654 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-164b7e29-4557-485e-8efb-260aea3de054 req-bef175db-0aea-40d8-bfc8-e5d0e27f07d8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035225 Aug 24 15:43:48.043286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 365/726] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:48.871275 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:48.871860 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:48.873869 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=10 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:48.879818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:48.880307 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:48.880744 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:48.881445 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:48.881899 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:48.882316 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:49.038310 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:49.046583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-58548eb9-96a6-4b8c-afcc-557cd1e2fdf4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1265 microversion: 2.1 time: 0.180216 Aug 24 15:43:49.047185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 362/727] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:48 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:50.068520 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:50.069257 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:50.075802 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:50.076290 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:50.076720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:50.077421 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:50.077883 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:50.078306 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:50.215525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:50.223228 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f360108f-f1a2-4815-8cac-fc1e42a6ecf5 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1453 microversion: 2.1 time: 0.159564 Aug 24 15:43:50.223798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 366/728] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:50 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:50.244471 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:50.245109 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:50.252041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:50.252528 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:50.252962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:50.253659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:50.254110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:50.254531 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:50.399966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:50.408127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-19d401c2-1656-49f2-b2d3-0cf0bfd38d08 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1453 microversion: 2.1 time: 0.168027 Aug 24 15:43:50.408709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 363/729] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:50 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:52.139915 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:52.140468 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:52.147326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:52.147822 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:52.148250 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:52.149045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:52.149494 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:52.149914 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:52.248710 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lazy-loading 'services' on Instance uuid 2e5ba349-889b-48e9-a144-173d715cc532 {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:43:52.287122 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-78560ad3-9d61-4fd8-b303-a340e180abcd req-dd89ea90-4ea3-4fec-8d81-0a7d8e82d6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2939b24d-ed1a-4b5f-85c7-ba39b537afd2", "tag": "f082148e-fa4f-49a1-806d-e56c40305abb"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:52.298933 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-78560ad3-9d61-4fd8-b303-a340e180abcd req-dd89ea90-4ea3-4fec-8d81-0a7d8e82d6d5 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:52.299409 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-78560ad3-9d61-4fd8-b303-a340e180abcd req-dd89ea90-4ea3-4fec-8d81-0a7d8e82d6d5 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:52.299958 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-78560ad3-9d61-4fd8-b303-a340e180abcd req-dd89ea90-4ea3-4fec-8d81-0a7d8e82d6d5 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:52.326127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-78560ad3-9d61-4fd8-b303-a340e180abcd req-dd89ea90-4ea3-4fec-8d81-0a7d8e82d6d5 service nova] Creating event network-changed:f082148e-fa4f-49a1-806d-e56c40305abb for instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 on hv-cinder-84605 Aug 24 15:43:52.331320 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-78560ad3-9d61-4fd8-b303-a340e180abcd req-dd89ea90-4ea3-4fec-8d81-0a7d8e82d6d5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048268 Aug 24 15:43:52.332334 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 364/730] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:52.332768 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ed63782b-e4f3-4fdd-810c-77fa852e4826 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments/e86ff130-0088-4486-ae5d-bf447c9e6e87" status: 202 len: 0 microversion: 2.1 time: 0.196661 Aug 24 15:43:52.333826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 367/731] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 15:43:52 2022] DELETE /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments/e86ff130-0088-4486-ae5d-bf447c9e6e87 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:43:52.342905 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:52.345429 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:52.365878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:52.367100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:52.368159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:52.370766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:52.371480 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:52.372324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:52.406818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-95967d41-f421-463b-866b-857d126a857a tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068182 Aug 24 15:43:52.407596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 365/732] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:52 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:43:52.563318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:52.564706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:52.574682 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:52.575166 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:52.578773 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:52.579523 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:52.580015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:52.580450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:52.609262 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-dd48610d-e591-4d53-b468-a947e86df61b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/ips" status: 200 len: 152 microversion: 2.20 time: 0.050424 Aug 24 15:43:52.610249 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 368/733] 10.222.0.73 () {60 vars in 1289 bytes} [Wed Aug 24 15:43:52 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:43:53.419895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:53.422032 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:53.434961 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:53.435495 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:53.435941 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:53.436661 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:53.437118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:53.437561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:53.468287 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-645f99a1-98da-45c5-9abc-d8520bc781b0 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052272 Aug 24 15:43:53.468881 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 366/734] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:53 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:43:53.546021 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:53.546608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:53.554273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:53.554823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:53.555346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:53.556042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:53.556497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:53.556923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:53.583850 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:43:53.673944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-227cc732-e043-41b3-9d91-6951186ee923 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 204 len: 0 microversion: 2.1 time: 0.132253 Aug 24 15:43:53.674886 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 369/735] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:43:53 2022] DELETE /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:53.685246 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:53.686186 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:53.692671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:53.693269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:53.693790 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:53.694680 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:53.695205 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:53.695847 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:53.833209 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:53.841614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8a32f426-400b-4422-a07b-6b9bb840b190 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1680 microversion: 2.1 time: 0.160548 Aug 24 15:43:53.842190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 367/736] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:53 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:43:54.865080 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:54.865774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:54.872387 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:54.872955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:54.873399 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:54.874094 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:54.877491 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:54.878051 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:55.018959 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:55.026737 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3d3bbafb-531f-417f-bd65-de74991c9caf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1680 microversion: 2.1 time: 0.165963 Aug 24 15:43:55.027306 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 370/737] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:54 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:55.028293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:55.028837 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:55.035347 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:55.035835 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:55.036269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:55.036965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:55.037420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:55.037844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:55.061675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lazy-loading 'flavor' on Instance uuid 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:43:55.129430 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:55.259097 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-58429552-c9ae-40e5-b2ff-b1d02a213abc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/action" status: 202 len: 0 microversion: 2.20 time: 0.234440 Aug 24 15:43:55.259695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 368/738] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 15:43:55 2022] POST /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:55.267848 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:55.268449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:55.277047 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:55.277732 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:55.278195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:55.279079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:55.279537 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:55.279997 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:55.414883 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:55.423111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:55.424680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:55.425827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-28e7914d-fa6e-416b-87b8-c804bb647242 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.161839 Aug 24 15:43:55.426375 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 371/739] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:55 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:56.049235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:56.049931 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:56.056971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.057446 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.057869 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.058560 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.059035 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.059453 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.202815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1541e1614d664891b1952379b003ed71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8dd47a9d30492eb7163da543d874cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:56.210340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a9b8dcc4-6cce-46bc-adbf-f94b6e429d31 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 200 len: 1680 microversion: 2.1 time: 0.165816 Aug 24 15:43:56.211030 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 369/740] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:56 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:43:56.450379 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:56.450957 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:56.457417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.457937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.458371 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.459157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.459662 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.460540 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.465353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:56.556576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-4a481fb6-eade-4e19-883a-b107f5eafedb req-f6eec8e0-51b3-4bfb-b1f6-9b70fa9254ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e5ba349-889b-48e9-a144-173d715cc532", "name": "network-vif-deleted", "tag": "1f59ed6f-c2a7-4b96-887e-58d69156e466"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:56.567754 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-4a481fb6-eade-4e19-883a-b107f5eafedb req-f6eec8e0-51b3-4bfb-b1f6-9b70fa9254ed service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.568405 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-4a481fb6-eade-4e19-883a-b107f5eafedb req-f6eec8e0-51b3-4bfb-b1f6-9b70fa9254ed service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.568992 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-4a481fb6-eade-4e19-883a-b107f5eafedb req-f6eec8e0-51b3-4bfb-b1f6-9b70fa9254ed service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.585312 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-4a481fb6-eade-4e19-883a-b107f5eafedb req-f6eec8e0-51b3-4bfb-b1f6-9b70fa9254ed service nova] Creating event network-vif-deleted:1f59ed6f-c2a7-4b96-887e-58d69156e466 for instance 2e5ba349-889b-48e9-a144-173d715cc532 on hv-cinder-84605 Aug 24 15:43:56.596559 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-4a481fb6-eade-4e19-883a-b107f5eafedb req-f6eec8e0-51b3-4bfb-b1f6-9b70fa9254ed service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044122 Aug 24 15:43:56.598013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 370/741] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:56.629913 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:56.639168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:56.641049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:56.642536 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-68951fcd-4c97-4249-b086-ecd1fec85165 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.196306 Aug 24 15:43:56.643405 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 372/742] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:56 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:57.234309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:57.235065 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:57.242511 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.243043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.243488 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.244197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.244654 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.245083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.259557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 HTTP/1.1 Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:57.261190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:57.263082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '2e5ba349-889b-48e9-a144-173d715cc532'} Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:57.263906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:57.265403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:57.266797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:57.266797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cd996141-f5fc-43ea-8d56-76fb6710e4d3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 404 len: 111 microversion: 2.1 time: 0.032695 Aug 24 15:43:57.266797 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 371/743] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:57 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:43:57.271837 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1fd599a7-9746-4fef-8a98-b6747f28814c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '.version_select at 0x7f0790609e50>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:57.292688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1fd599a7-9746-4fef-8a98-b6747f28814c tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218688719" status: 202 len: 0 microversion: 2.1 time: 0.024662 Aug 24 15:43:57.293276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 373/744] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 15:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218688719 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:43:57.666511 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:57.667306 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:57.673454 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.673942 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.674377 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.675179 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.675638 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.676063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.877587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:57.891832 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:57.893731 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:57.894827 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ff863b4f-65ba-469f-9618-1054060dbf08 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.233032 Aug 24 15:43:57.895504 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 372/745] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:57 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:58.919576 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:58.920329 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:58.926243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:58.926757 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:58.927195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:58.927894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:58.928348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:58.928769 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.057604 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:59.066327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:59.067909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:59.069055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-74fe45fe-9628-49b1-93e4-df23154e923a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.154188 Aug 24 15:43:59.069644 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 374/746] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:43:58 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:43:59.179533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:59.180016 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:59.186480 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.187000 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.187437 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.188127 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.188589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.189014 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.355081 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: DELETE /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 HTTP/1.1 Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:43:59.356659 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.358235 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '2e5ba349-889b-48e9-a144-173d715cc532'} Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:59.359274 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.360804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.362308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:59.362308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-782c23ba-9b85-4f72-963e-95afc2ac6c16 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 404 len: 111 microversion: 2.1 time: 0.182876 Aug 24 15:43:59.362308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 373/747] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:43:59 2022] DELETE /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:43:59.366518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:59.367223 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 2e5ba349-889b-48e9-a144-173d715cc532] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:59.373164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.373641 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.374072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.374776 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.375229 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.375651 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.388502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 HTTP/1.1 Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:43:59.390097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.391681 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '2e5ba349-889b-48e9-a144-173d715cc532'} Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:43:59.392794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. Aug 24 15:43:59.394240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:43:59.395687 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance 2e5ba349-889b-48e9-a144-173d715cc532 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:43:59.395687 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9dd22d6c-2c17-4f2e-9ac8-2bb626f4b712 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532" status: 404 len: 111 microversion: 2.1 time: 0.028742 Aug 24 15:43:59.395687 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 375/748] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:59 2022] GET /compute/v2.1/servers/2e5ba349-889b-48e9-a144-173d715cc532 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:00.092285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:00.092883 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:00.098656 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:00.099128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:00.099559 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:00.100231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:00.100672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:00.101683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:00.229330 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:00.237365 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:00.238902 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:00.240054 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fe7948c0-d287-47b4-9166-9d5585baa22f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.151802 Aug 24 15:44:00.240599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 374/749] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:00 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:01.263156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:01.263753 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:01.270081 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:01.270553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:01.271010 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:01.271688 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:01.272133 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:01.272551 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:01.409022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:01.417541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:01.419063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:01.420225 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-787cc417-f750-445b-bfc4-41e3a4561010 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.160941 Aug 24 15:44:01.420768 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 376/750] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:01 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:02.443312 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:02.443925 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:02.450787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:02.451279 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:02.451718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:02.452412 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:02.452866 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:02.453290 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:02.580735 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:02.588925 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:02.590418 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:02.591615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e666a746-5152-4fae-b311-3c097a82cffd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.152150 Aug 24 15:44:02.592159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 375/751] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:02 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:03.614955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:03.615547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:03.618373 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:03.623592 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:03.624075 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:03.624499 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:03.625175 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:03.625617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:03.626029 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:03.763120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:03.771167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:03.773324 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:03.774526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3f234a55-0b25-470c-adc0-8c47171eeb39 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.163563 Aug 24 15:44:03.775123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 377/752] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:03 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:04.213639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-613343584", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1038709999", "security_groups": [{"name": "tempest-secgroup-smoke-1765465197"}], "networks": [{"uuid": "aa79d787-98ad-44e1-9e78-dc2cd956b8d9"}], "block_device_mapping_v2": [{"uuid": "1c3a8d4b-ac58-4da6-b73b-b7d08c0ccbe8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:04.330598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] validate_networks() for [('aa79d787-98ad-44e1-9e78-dc2cd956b8d9', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:44:04.707927 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:44:04.708346 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:44:04.708842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:44:04.709243 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:44:04.709643 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:44:04.718438 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.718879 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.719307 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.720023 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.720470 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.720883 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.738469 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Getting quotas for project 3760b78ba8584e6c81c46d48113fcd45. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:44:04.739597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:04.740094 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:04.743295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Getting quotas for user 90be4ab702e14f4387b0883dead72d9f and project 3760b78ba8584e6c81c46d48113fcd45. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:44:04.746991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.747472 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.747910 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.748603 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.749054 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.749480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.763991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b HTTP/1.1 Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:44:04.765533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.767141 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b'} Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:04.768190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.769483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.770817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:04.770817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d3a4aa8c-7ee7-4b1e-9912-74b38466cdc3 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 404 len: 111 microversion: 2.1 time: 0.031161 Aug 24 15:44:04.770817 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 378/753] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:44:04 2022] DELETE /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:04.777429 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:04.778044 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:04.783806 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.784289 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.784725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.785736 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.785860 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.786288 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.800055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b HTTP/1.1 Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:44:04.801562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.803142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b'} Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:04.804255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. Aug 24 15:44:04.805634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.806798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance 1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:04.806877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:44:04.806972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-eb0b6bbf-3c33-4370-932c-489982ff031d tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b" status: 404 len: 111 microversion: 2.1 time: 0.029303 Aug 24 15:44:04.806972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 379/754] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:04 2022] GET /compute/v2.1/servers/1d95318e-d4b7-4a6b-8ecf-d2fd8e2fb97b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:04.807141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c3a8d4b-ac58-4da6-b73b-b7d08c0ccbe8',volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:44:04.808149 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:04.808751 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:04.814586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.815163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.815598 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.816288 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.816744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.817167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.939825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b81e23ea-9323-4ee2-a996-b0bb49cba47a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730769 Aug 24 15:44:04.940781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 376/755] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:44:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:44:04.946256 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:04.946992 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:04.953476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.953959 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.954392 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.955146 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:04.955639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:04.956080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:04.958629 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:04.967985 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:04.970106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:04.970409 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: DELETE /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 HTTP/1.1 Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:44:04.971709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:04.973033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'f7f35f56-4bfe-416c-861e-c49c02f623c2'} Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:04.973781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:04.975031 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:04.977861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f2bb1769-d80d-4118-aa7e-b1c81fbee14b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.167389 Aug 24 15:44:04.978092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:04.978197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 380/756] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:04 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:04.978197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-dbadcfb2-1b15-4e0b-8a53-8045ed69cf01 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:04.979186 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-dbadcfb2-1b15-4e0b-8a53-8045ed69cf01 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:04.987876 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f9a75a7a-c047-4abc-89d6-7532c3aae7e7 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 404 len: 111 microversion: 2.1 time: 0.045583 Aug 24 15:44:04.988613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 377/757] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:44:04 2022] DELETE /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:04.999463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:05.000146 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: f7f35f56-4bfe-416c-861e-c49c02f623c2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:05.020723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:05.021245 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:05.021759 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:05.022828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:05.023527 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:05.024253 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:05.039049 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 HTTP/1.1 Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:44:05.040582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:05.041918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'f7f35f56-4bfe-416c-861e-c49c02f623c2'} Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:05.042694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. Aug 24 15:44:05.043919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.045016 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance f7f35f56-4bfe-416c-861e-c49c02f623c2 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:05.045103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-dbadcfb2-1b15-4e0b-8a53-8045ed69cf01 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:05.045202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4acd03c0-4360-40bd-9d4c-6fbb21279da5 tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2" status: 404 len: 111 microversion: 2.1 time: 0.048355 Aug 24 15:44:05.046350 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 378/758] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:04 2022] GET /compute/v2.1/servers/f7f35f56-4bfe-416c-861e-c49c02f623c2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:05.048716 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-dbadcfb2-1b15-4e0b-8a53-8045ed69cf01 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1088 microversion: 2.1 time: 0.074827 Aug 24 15:44:05.049281 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 381/759] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:04 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:05.996261 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:05.997071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:06.003613 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.004240 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.004978 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.005935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.006458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.007243 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.069776 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:06.070348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:06.077157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.077637 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.078272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.079374 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.079991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.080573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.175054 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:06.188981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:06.192153 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-969303ce-9b6f-46f9-a69a-be1a9f95e143 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1194 microversion: 2.1 time: 0.126594 Aug 24 15:44:06.202962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 382/760] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:06 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:06.203086 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:06.203086 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:06.203086 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ba5d123a-b42f-4ceb-977d-dff7b3fb21cd tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.210467 Aug 24 15:44:06.204160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 379/761] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:05 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:44:06.214247 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:06.214932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:06.223744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.224229 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.224699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.225417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.225872 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.226298 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.240417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 HTTP/1.1 Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:44:06.242170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.243541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'd719a892-4ac9-42ad-973b-ecc96a5df4a6'} Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:06.244286 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.245665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.247347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:06.247347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e914a829-8254-4daa-ab07-cfae12b06acb tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 404 len: 111 microversion: 2.1 time: 0.033833 Aug 24 15:44:06.247347 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 383/762] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:44:06 2022] DELETE /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:06.252010 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:06.252605 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] [instance: d719a892-4ac9-42ad-973b-ecc96a5df4a6] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:06.259700 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.260688 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.261115 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.262414 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:06.262414 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:06.262742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:06.278803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] HTTP exception thrown: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Request method failure captured: Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 HTTP/1.1 Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkW5su8fJFVBtnuZhXdta6n4AJZA7hPPgqC6UGj8gnlUKspsfRWW7oipq_kw30Z0-MeEp9iO6-dxbWna9LusCEMQB4Glvun4s13mB5y4v2AhOTgQqIeiaPEUlVdOMjwjX-gUmtF3mft_i0YGpSin4fxB6yWE7L-MA0nVDlRYoxZ33HU Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:44:06.280241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0b8dd47a9d30492eb7163da543d874cb", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0b8dd47a9d30492eb7163da543d874cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0b8dd47a9d30492eb7163da543d874cb"}]}] Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 0b8dd47a9d30492eb7163da543d874cb Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1584030001 Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 1541e1614d664891b1952379b003ed71 Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeNegativeTest-1584030001-project Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.281944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'd719a892-4ac9-42ad-973b-ecc96a5df4a6'} Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:06.282878 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. Aug 24 15:44:06.284389 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:06.285718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] Returning 404 to user: Instance d719a892-4ac9-42ad-973b-ecc96a5df4a6 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:06.285718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ea3ec975-b9c2-4584-9ede-d8b3bfbdeaaf tempest-AttachVolumeNegativeTest-1584030001 tempest-AttachVolumeNegativeTest-1584030001-project] 10.222.0.73 "GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6" status: 404 len: 111 microversion: 2.1 time: 0.033498 Aug 24 15:44:06.285718 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 380/763] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:06 2022] GET /compute/v2.1/servers/d719a892-4ac9-42ad-973b-ecc96a5df4a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:07.217364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:07.218937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:07.226236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.226564 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:07.227249 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:07.228177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.228833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.229755 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.230426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.231111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.239663 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:07.241739 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.242239 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.242708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.245804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.246280 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.247592 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.549131 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:07.563836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:07.565710 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:07.567497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-58225fc6-c26d-4519-86c1-73888d6069c7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.345382 Aug 24 15:44:07.568281 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 381/764] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:07 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:44:07.574451 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-793b96c3-090f-4fec-994d-5af99abc216a req-22b0c4eb-895a-4f2c-81dd-739420010a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23653e1-bc7c-46f9-b66a-b2744f35f5e2", "tag": "91c5b662-a602-4af7-bcaa-b2673cf2db1a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:07.590914 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:07.597997 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-793b96c3-090f-4fec-994d-5af99abc216a req-22b0c4eb-895a-4f2c-81dd-739420010a01 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.598856 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-793b96c3-090f-4fec-994d-5af99abc216a req-22b0c4eb-895a-4f2c-81dd-739420010a01 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.599442 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-793b96c3-090f-4fec-994d-5af99abc216a req-22b0c4eb-895a-4f2c-81dd-739420010a01 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.603573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1b062b29-9c7f-41f3-8a8c-a8b0d5f6b29b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.389871 Aug 24 15:44:07.619408 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 384/765] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:07 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:07.625582 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-793b96c3-090f-4fec-994d-5af99abc216a req-22b0c4eb-895a-4f2c-81dd-739420010a01 service nova] Creating event network-changed:91c5b662-a602-4af7-bcaa-b2673cf2db1a for instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 on hv-cinder-84605 Aug 24 15:44:07.630619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-793b96c3-090f-4fec-994d-5af99abc216a req-22b0c4eb-895a-4f2c-81dd-739420010a01 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059867 Aug 24 15:44:07.631315 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 382/766] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:08.593190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:08.594815 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:08.602211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:08.602989 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:08.603426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:08.604167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:08.604669 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:08.605104 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:08.631023 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:08.631887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:08.639842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:08.641224 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:08.641768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:08.642580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:08.643179 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:08.643703 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:08.919302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:08.928157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:08.931934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:08.936042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:08.951348 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1e89ef19-0bbc-4128-a9ab-580d31b4d43b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.361957 Aug 24 15:44:08.952278 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 385/767] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:08 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:08.954681 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5e4741c3-85e2-4b02-a6dd-c5325d0aa4c2 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.332245 Aug 24 15:44:08.955570 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 383/768] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:08 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:09.983067 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:09.984512 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:09.989990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:09.990954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:10.010608 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:10.017537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:10.017981 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:10.021682 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:10.022813 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:10.023208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:10.023913 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:10.024394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:10.024782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:10.026698 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:10.028071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:10.028783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:10.301426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:10.312099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:10.313869 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:10.315238 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a518b6fa-5d37-4165-9b1a-8a8e43b8f48b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.344521 Aug 24 15:44:10.315904 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 386/769] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:09 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:10.321136 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:10.329705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-aeebea2e-efb3-43a0-9fc3-518a4e5cddf0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.357686 Aug 24 15:44:10.330699 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 384/770] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:09 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:11.341626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:11.342284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:11.349072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:11.349554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:11.350204 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:11.351606 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:11.352072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:11.352755 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:11.376738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bc1992cd-b163-4a49-833b-9afd3921932b tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Action: 'create', calling method: .version_select at 0x7f079065d8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1478407391", "metadata": {"Type": "work"}}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:11.497615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:11.505879 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:11.507952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:11.509193 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-82ac3043-802a-4294-b353-18a9073ccd69 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.171505 Aug 24 15:44:11.509740 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 385/771] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:11 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:44:11.514238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:11.515047 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:11.521577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:11.522726 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:11.523245 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:11.524114 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:11.524682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:11.525109 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:11.680209 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:11.688038 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d9f439cb-902d-4ede-9cd2-976eb8f9e4ac tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.177139 Aug 24 15:44:11.688603 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 386/772] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:11 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:11.696099 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bc1992cd-b163-4a49-833b-9afd3921932b tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.438268 Aug 24 15:44:11.696908 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 387/773] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 15:44:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 15:44:11.711885 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-5a7b34fb-24f3-4018-b0ba-bee37b60975e tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Calling method '.version_select at 0x7f0783471f70>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:11.778843 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-5a7b34fb-24f3-4018-b0ba-bee37b60975e tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790" status: 200 len: 353 microversion: 2.1 time: 0.072684 Aug 24 15:44:11.783166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 387/774] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:44:11 2022] GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:12.533394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:12.533991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:12.541552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:12.542025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:12.542448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:12.543150 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:12.543595 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:12.544010 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:12.674242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:12.682842 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:12.684343 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:12.685543 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7c59271a-6cc1-4396-88da-90d9b5af7b3f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.156560 Aug 24 15:44:12.686111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 388/775] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:12 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:12.715083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:12.715723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:12.721870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:12.722387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:12.722858 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:12.723554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:12.724020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:12.724448 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:12.793474 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1a4c2b8b-616f-49af-b226-085d45a26276 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Calling method '.version_select at 0x7f079061a4c0>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:12.839701 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1a4c2b8b-616f-49af-b226-085d45a26276 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790" status: 200 len: 354 microversion: 2.1 time: 0.050059 Aug 24 15:44:12.840452 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 389/776] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:44:12 2022] GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:44:12.853625 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-adc9e58f-2103-46c2-a1fa-08fff333e74d tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Calling method '.version_select at 0x7f0790625d30>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:12.862967 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:12.871681 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-599390db-198c-405e-9dbe-b3141657191a tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.160887 Aug 24 15:44:12.872239 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 388/777] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:12 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:12.907843 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-adc9e58f-2103-46c2-a1fa-08fff333e74d tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790" status: 200 len: 354 microversion: 2.1 time: 0.059315 Aug 24 15:44:12.908416 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 390/778] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:44:12 2022] GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:44:12.927104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cbd509c8-34b3-40d8-baf5-f42e8b1f4e26 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Calling method '.version_select at 0x7f0783545700>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:12.995115 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cbd509c8-34b3-40d8-baf5-f42e8b1f4e26 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790" status: 202 len: 0 microversion: 2.1 time: 0.072490 Aug 24 15:44:12.995811 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 389/779] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 15:44:12 2022] DELETE /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:44:13.004014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-407acca9-fe32-4ee1-912e-7b18c8325149 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Calling method '.version_select at 0x7f0790585790>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:13.051498 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-407acca9-fe32-4ee1-912e-7b18c8325149 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790" status: 200 len: 353 microversion: 2.1 time: 0.051559 Aug 24 15:44:13.052148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 391/780] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:44:12 2022] GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:44:13.708914 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:13.709454 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:13.715779 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:13.716376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:13.716685 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:13.717377 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:13.717831 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:13.718255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:13.846991 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:13.856006 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:13.857507 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:13.858678 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6a04e6a7-6e31-4c92-9cf9-6f7e2840c96f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.153856 Aug 24 15:44:13.859226 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 390/781] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:13 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:13.893115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:13.893764 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:13.900615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:13.901129 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:13.901560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:13.902235 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:13.902782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:13.903205 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:14.036430 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:14.044572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-96896d4f-3515-4760-8fa0-b6199af58d11 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.156092 Aug 24 15:44:14.045220 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 392/782] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:13 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:14.066245 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0d9f5f31-10c4-4061-93c5-cb0fb014e0b2 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Calling method '.version_select at 0x7f0783545790>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:14.096731 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-0d9f5f31-10c4-4061-93c5-cb0fb014e0b2 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] HTTP exception thrown: Volume d0d5dcec-5641-4f4e-b8b9-20fc68c80790 could not be found. Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0d9f5f31-10c4-4061-93c5-cb0fb014e0b2 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Request method failure captured: Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790 HTTP/1.1 Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkdLpllqLWoI03Ly1lF_FIYI4RM7UKr5sB6GU-u38Szlv3pxci6a2oVf8gsNrBSp2ydyGogx8_boAUe5_5nxeDwjddn6jCftN5b27KYFZajn5KMiPjN2Owt9FIGRYE-biEv3ZWaxuBVECYTodU6xrGQBKTKeQu_Tn8Nhja1744Z2r-U Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 8cc56d9ec152477db041647ee1ff1b2a Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-VolumesGetTestJSON-624446891 Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:44:14.098910 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8cc56d9ec152477db041647ee1ff1b2a", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8cc56d9ec152477db041647ee1ff1b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8cc56d9ec152477db041647ee1ff1b2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8cc56d9ec152477db041647ee1ff1b2a"}]}] Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-VolumesGetTestJSON-624446891 Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 8cc56d9ec152477db041647ee1ff1b2a Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-VolumesGetTestJSON-624446891 Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-VolumesGetTestJSON-624446891-project Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: d667576f13d2435e99df66fac5dfe5c6 Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-VolumesGetTestJSON-624446891-project Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Volume d0d5dcec-5641-4f4e-b8b9-20fc68c80790 could not be found. Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'd0d5dcec-5641-4f4e-b8b9-20fc68c80790'} Aug 24 15:44:14.101340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0d5dcec-5641-4f4e-b8b9-20fc68c80790 could not be found. (HTTP 404) (Request-ID: req-3ba965fa-5a35-4500-a25b-93f6208a0b05) Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:14.102705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:44:14.104106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0d5dcec-5641-4f4e-b8b9-20fc68c80790 could not be found. Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:44:14.105329 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0d5dcec-5641-4f4e-b8b9-20fc68c80790 could not be found. Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0d5dcec-5641-4f4e-b8b9-20fc68c80790 could not be found. Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0d9f5f31-10c4-4061-93c5-cb0fb014e0b2 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] Returning 404 to user: Volume d0d5dcec-5641-4f4e-b8b9-20fc68c80790 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0d9f5f31-10c4-4061-93c5-cb0fb014e0b2 tempest-VolumesGetTestJSON-624446891 tempest-VolumesGetTestJSON-624446891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790" status: 404 len: 109 microversion: 2.1 time: 0.039616 Aug 24 15:44:14.107934 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 391/783] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 15:44:14 2022] GET /compute/v2.1/os-volumes/d0d5dcec-5641-4f4e-b8b9-20fc68c80790 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:14.886064 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:14.886786 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:14.892918 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:14.893387 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:14.893954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:14.894476 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:14.894969 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:14.895368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:15.036217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:15.045456 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:15.046988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:15.048153 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-632b72cd-107a-4661-91e4-7b43f6693d1d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.166708 Aug 24 15:44:15.048714 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 393/784] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:14 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:15.062906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:15.063757 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:15.068667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:15.069770 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:15.077639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:15.078130 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:15.078568 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:15.079312 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:15.079767 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:15.080191 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:15.237168 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:15.248947 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7f2876bb-e18c-4221-b89d-50684a1e1789 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.187523 Aug 24 15:44:15.249758 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 392/785] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:15 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:16.071788 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:16.072395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:16.074236 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:16.079918 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:16.080406 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:16.080846 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:16.081539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:16.081991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:16.082417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:16.219504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:16.228609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:16.230108 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:16.231306 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a2a2d246-abcc-48af-84e7-9d085f3535f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1744 microversion: 2.20 time: 0.163629 Aug 24 15:44:16.231871 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 394/786] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:16 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:16.273986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:16.274894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:16.281737 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:16.282217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:16.282673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:16.283385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:16.283932 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:16.284456 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:16.307116 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=100 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:16.453158 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:16.462496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-dfd11cd9-a297-4d75-8a1e-e6134b010349 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.192889 Aug 24 15:44:16.463103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 393/787] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:16 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:17.254905 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:17.255542 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:17.262514 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:17.263405 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:17.263872 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:17.264599 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:17.265066 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:17.265479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:17.410976 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:17.423990 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:17.428565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:17.430082 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ce39d875-3245-4611-be30-7e099bfa3daf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1744 microversion: 2.20 time: 0.178968 Aug 24 15:44:17.440991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 395/788] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:17 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:17.483803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:17.484417 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:17.491118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:17.491625 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:17.492064 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:17.492772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:17.493229 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:17.493655 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:17.640196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:17.651466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-29d6c0ec-5801-4a27-bdce-a1bfe020131e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.171329 Aug 24 15:44:17.652143 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 394/789] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:17 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:18.453120 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:18.453728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:18.461057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:18.461462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:18.461894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:18.462584 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:18.463072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:18.463500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:18.605447 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:18.614699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:18.616916 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:18.618127 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5d0ab294-73ab-4812-8845-5c1e0cce8d29 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1744 microversion: 2.20 time: 0.168857 Aug 24 15:44:18.618714 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 396/790] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:18 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:18.673202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:18.673816 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:18.681419 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:18.682077 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:18.683088 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:18.684070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:18.684704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:18.685229 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:18.857485 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:18.879105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a89c3f5d-6217-4bfc-ad89-584d801bd9b3 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.207630 Aug 24 15:44:18.880059 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 395/791] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:18 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:19.644049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:19.644670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:19.651927 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:19.652620 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:19.653046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:19.653736 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:19.654188 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:19.654603 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:19.674794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=100 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:19.822072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:19.832893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:19.835336 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:19.836610 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c0667718-3eed-417d-8797-7e474cc326d7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.199131 Aug 24 15:44:19.837689 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 397/792] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:19 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:19.904998 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:19.905749 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:19.913396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:19.914269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:19.914971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:19.916003 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:19.916387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:19.916921 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:20.095891 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:20.107497 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-60738e55-2cd9-4fc6-b69c-a4357440aff6 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.207454 Aug 24 15:44:20.108918 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 396/793] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:19 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:20.861272 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:20.861987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:20.869052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:20.869826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:20.870581 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:20.871532 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:20.872055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:20.872703 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:21.023156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:21.032276 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:21.033886 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:21.035154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f1e4b0b8-533e-4dad-96a9-5a9e76f1e82d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.178007 Aug 24 15:44:21.036009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 398/794] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:20 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:21.129596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:21.130238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:21.137343 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:21.137958 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:21.139020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:21.139956 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:21.140436 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:21.140887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:21.377628 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:21.391173 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2b4b554a-fec5-45a3-88cc-e8673938e949 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.265552 Aug 24 15:44:21.393949 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 397/795] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:21 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:22.061294 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:22.061969 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:22.069302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:22.069967 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:22.070880 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:22.071583 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:22.072199 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:22.072628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:22.228541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:22.237723 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:22.240677 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:22.242254 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-809209cb-4fc2-4332-98df-9466e102d946 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.185592 Aug 24 15:44:22.243704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 399/796] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:22 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:22.414503 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:22.415904 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:22.423258 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:22.424040 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:22.424679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:22.425591 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:22.426292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:22.426965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:22.610674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:22.620562 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-67db9b0c-7d17-41b9-9a31-9482a57e3625 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.211299 Aug 24 15:44:22.638699 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 398/797] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:22 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:23.268303 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:23.269702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:23.282218 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:23.283179 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:23.296819 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:23.297928 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:23.299505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:23.300102 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:23.522318 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:23.537122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:23.539308 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:23.540851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0d77bb3e-f795-4aa7-be16-50cdae38ed5c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.276694 Aug 24 15:44:23.541932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 400/798] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:23 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:23.574087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-a5041115-0780-4cf5-b209-396aab650cf0 req-562a9375-91b8-4d0d-84d9-b263a3a543fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6562ed4a-9a9b-454e-a4fd-d0c2e7d19452", "name": "network-vif-plugged", "status": "completed", "tag": "d8aa5e82-99d7-4489-bc2f-7393036fdb8a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:23.593697 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a5041115-0780-4cf5-b209-396aab650cf0 req-562a9375-91b8-4d0d-84d9-b263a3a543fb service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:23.595926 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a5041115-0780-4cf5-b209-396aab650cf0 req-562a9375-91b8-4d0d-84d9-b263a3a543fb service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:23.596366 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-a5041115-0780-4cf5-b209-396aab650cf0 req-562a9375-91b8-4d0d-84d9-b263a3a543fb service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:23.616285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-a5041115-0780-4cf5-b209-396aab650cf0 req-562a9375-91b8-4d0d-84d9-b263a3a543fb service nova] Creating event network-vif-plugged:d8aa5e82-99d7-4489-bc2f-7393036fdb8a for instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 on hv-cinder-84605 Aug 24 15:44:23.627387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-a5041115-0780-4cf5-b209-396aab650cf0 req-562a9375-91b8-4d0d-84d9-b263a3a543fb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057315 Aug 24 15:44:23.627985 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 399/799] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:23.648877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:23.649510 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:23.656405 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:23.656893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:23.657528 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:23.658411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:23.658892 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:23.659475 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:23.895584 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:23.908366 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-85e13d0f-744a-4441-b7c0-dae31c9c9021 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.266117 Aug 24 15:44:23.909608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 401/800] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:23 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:24.572640 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:24.573331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:24.581218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:24.582396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:24.584202 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:24.584922 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:24.585373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:24.585963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:24.783404 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:24.793345 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:24.795068 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:24.796561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-49066be3-f3b2-4144-881d-786b6a9764f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.228296 Aug 24 15:44:24.797356 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 400/801] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:24 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:24.933592 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:24.934172 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:24.942444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:24.943003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:24.943457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:24.944148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:24.944599 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:24.945015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:25.106716 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:25.116587 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2b9a9dc7-113a-4ef1-842f-1ca462c0b746 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.189262 Aug 24 15:44:25.117372 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 402/802] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:24 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:25.662872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-fd0ff682-5437-4444-b4e4-d23f3191b886 req-41c844d7-9631-4efe-b5ac-16e723c0bf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23653e1-bc7c-46f9-b66a-b2744f35f5e2", "name": "network-vif-plugged", "status": "completed", "tag": "91c5b662-a602-4af7-bcaa-b2673cf2db1a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:25.674634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-fd0ff682-5437-4444-b4e4-d23f3191b886 req-41c844d7-9631-4efe-b5ac-16e723c0bf29 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:25.675408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-fd0ff682-5437-4444-b4e4-d23f3191b886 req-41c844d7-9631-4efe-b5ac-16e723c0bf29 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:25.675840 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-fd0ff682-5437-4444-b4e4-d23f3191b886 req-41c844d7-9631-4efe-b5ac-16e723c0bf29 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:25.695078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-fd0ff682-5437-4444-b4e4-d23f3191b886 req-41c844d7-9631-4efe-b5ac-16e723c0bf29 service nova] Creating event network-vif-plugged:91c5b662-a602-4af7-bcaa-b2673cf2db1a for instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 on hv-cinder-84605 Aug 24 15:44:25.703152 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-fd0ff682-5437-4444-b4e4-d23f3191b886 req-41c844d7-9631-4efe-b5ac-16e723c0bf29 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044962 Aug 24 15:44:25.706350 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 401/803] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:25.823412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:25.824122 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:25.830609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:25.831719 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:25.832394 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:25.834038 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:25.834968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:25.835620 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:26.139282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:26.140268 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:26.148416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:26.149187 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:26.149834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:26.150898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:26.151543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:26.151973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:26.335164 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:26.346925 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:26.348763 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:26.351040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-81addc89-ad1c-444e-b064-63b32b6c9694 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.532887 Aug 24 15:44:26.351572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 403/804] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:25 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:26.434708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:26.445766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-85499113-eba2-4791-bd56-0de013100301 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.311460 Aug 24 15:44:26.460453 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 402/805] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:26 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:27.376430 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:27.377215 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:27.386988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:27.387830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:27.388638 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:27.389480 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:27.389986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:27.390829 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:27.468228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:27.469605 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:27.478111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:27.478964 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:27.479599 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:27.480494 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:27.481079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:27.481728 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:27.696217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:27.710738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:27.712586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:27.713987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1725ab2c-f36c-40e4-b39f-edab317d9b35 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.341717 Aug 24 15:44:27.715163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 404/806] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:27 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:27.791798 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:27.801022 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8077ab5b-b2fd-41ce-93a7-d97763eb04ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1260 microversion: 2.1 time: 0.337497 Aug 24 15:44:27.821168 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 403/807] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:27 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1260 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:28.739198 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:28.744866 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:28.752896 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:28.753923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:28.754539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:28.756224 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:28.757540 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:28.758442 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:28.838340 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:28.843112 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:28.851990 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:28.853140 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:28.853886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:28.854888 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:28.855580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:28.856301 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:29.050068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:29.058869 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:29.060698 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:29.062057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-573f4b0c-387e-449f-8c87-bc82fd832645 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1739 microversion: 2.20 time: 0.328451 Aug 24 15:44:29.071441 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 405/808] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:28 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:29.102894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:29.112607 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9c8677bd-67bc-45bf-8bc7-ff01f00e6bb7 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1444 microversion: 2.1 time: 0.281279 Aug 24 15:44:29.125595 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 404/809] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:28 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1444 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:29.134986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:29.146518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:29.146518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:29.146518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:29.146518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:29.147450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:29.147450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:29.147450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:29.299392 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:29.311692 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3b38c5f9-3de6-4cd8-a690-da73b25ead6e tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1444 microversion: 2.1 time: 0.181109 Aug 24 15:44:29.312830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 406/810] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:29 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:30.088468 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:30.089704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:30.097080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:30.097691 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:30.098375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:30.099696 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:30.100372 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:30.101230 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:30.253684 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:30.263888 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:30.266012 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:30.267642 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4c54075f-ed84-409a-a247-cbec092988d4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1721 microversion: 2.20 time: 0.184016 Aug 24 15:44:30.268418 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 405/811] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:30 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:31.293679 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:31.294852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:31.304397 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:31.305154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:31.305826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:31.306717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:31.307799 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:31.308393 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:31.459212 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:31.467651 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:31.469240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:31.470470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-99117a2f-f1c1-4f67-8619-69979f214cca tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1721 microversion: 2.20 time: 0.182195 Aug 24 15:44:31.471238 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 407/812] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:31 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:31.648939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-0dd0aa0c-4ac5-4cbb-9a91-4277685839f9 req-440d7e50-4eae-40c0-97b0-0b9fe4a36921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23653e1-bc7c-46f9-b66a-b2744f35f5e2", "tag": "91c5b662-a602-4af7-bcaa-b2673cf2db1a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:31.660970 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-0dd0aa0c-4ac5-4cbb-9a91-4277685839f9 req-440d7e50-4eae-40c0-97b0-0b9fe4a36921 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:31.663058 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-0dd0aa0c-4ac5-4cbb-9a91-4277685839f9 req-440d7e50-4eae-40c0-97b0-0b9fe4a36921 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:31.663687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-0dd0aa0c-4ac5-4cbb-9a91-4277685839f9 req-440d7e50-4eae-40c0-97b0-0b9fe4a36921 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:31.677078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-0dd0aa0c-4ac5-4cbb-9a91-4277685839f9 req-440d7e50-4eae-40c0-97b0-0b9fe4a36921 service nova] Creating event network-changed:91c5b662-a602-4af7-bcaa-b2673cf2db1a for instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 on hv-cinder-84605 Aug 24 15:44:31.683279 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-0dd0aa0c-4ac5-4cbb-9a91-4277685839f9 req-440d7e50-4eae-40c0-97b0-0b9fe4a36921 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039101 Aug 24 15:44:31.684316 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 406/813] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:32.493909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:32.494495 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:32.501497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:32.502008 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:32.502410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:32.503136 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:32.503587 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:32.504001 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:32.667414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:32.680247 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:32.682088 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:32.683621 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ff930a76-5598-4790-b9f5-2d8ddf244041 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1721 microversion: 2.20 time: 0.194221 Aug 24 15:44:32.686100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 408/814] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:32 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:33.712928 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:33.713643 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:33.719717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:33.720206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:33.720642 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:33.721343 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:33.721796 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:33.722223 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:33.868711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:33.877333 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:33.878844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:33.881598 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8b530fb5-3af2-4561-b2f6-8bfd952b2cfc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1664 microversion: 2.20 time: 0.172370 Aug 24 15:44:33.882171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 407/815] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:33 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:44:33.905901 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d92e869-1568-4853-972c-9646491149d8"}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:33.908361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:33.910634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=58 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:33.916764 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:33.917240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:33.917671 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:33.918349 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:33.919039 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:33.919460 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:34.216737 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-deb4b425-7d0a-4614-9629-a5eff37218d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314965 Aug 24 15:44:34.217634 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 409/816] 10.222.0.73 () {62 vars in 1364 bytes} [Wed Aug 24 15:44:33 2022] POST /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:44:34.358426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:34.359075 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:34.366763 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:34.367452 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:34.368837 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:34.369577 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:34.370041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:34.370690 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:34.416977 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132288) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 15:44:34.500353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7ebb08b6-0439-48dc-9cdf-4ce3dad78be2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/action" status: 202 len: 0 microversion: 2.20 time: 0.146356 Aug 24 15:44:34.504602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 408/817] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 15:44:34 2022] POST /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:44:34.510220 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:34.510988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:34.531244 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:34.531751 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:34.532371 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:34.533287 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:34.533993 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:34.535827 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:34.701119 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:34.710955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:34.712922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:34.714405 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-002203a8-c60c-4ca3-856f-e960f798c3bc tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1750 microversion: 2.20 time: 0.208719 Aug 24 15:44:34.715642 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 410/818] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:34 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1750 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:35.453496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-70ebd293-0f89-4ae8-8346-5aed59e0081d req-6bca559a-d853-4bfe-9b07-056af3ee2483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6562ed4a-9a9b-454e-a4fd-d0c2e7d19452", "name": "network-vif-unplugged", "status": "completed", "tag": "d8aa5e82-99d7-4489-bc2f-7393036fdb8a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:35.468713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-70ebd293-0f89-4ae8-8346-5aed59e0081d req-6bca559a-d853-4bfe-9b07-056af3ee2483 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:35.469923 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-70ebd293-0f89-4ae8-8346-5aed59e0081d req-6bca559a-d853-4bfe-9b07-056af3ee2483 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:35.470620 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-70ebd293-0f89-4ae8-8346-5aed59e0081d req-6bca559a-d853-4bfe-9b07-056af3ee2483 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:35.487593 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.compute.server_external_events [req-70ebd293-0f89-4ae8-8346-5aed59e0081d req-6bca559a-d853-4bfe-9b07-056af3ee2483 service nova] Unable to find a host for instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452. Dropping event network-vif-unplugged {{(pid=132288) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 15:44:35.488515 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-70ebd293-0f89-4ae8-8346-5aed59e0081d req-6bca559a-d853-4bfe-9b07-056af3ee2483 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040611 Aug 24 15:44:35.489110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 409/819] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 15:44:35.737848 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:35.739378 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:35.748402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:35.749038 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:35.749608 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:35.750623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:35.751103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:35.751530 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:35.776880 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:35.928965 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:35.943881 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:35.946144 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:35.947838 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f2a5db70-da80-4b5a-bc4a-7b5589760e44 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1750 microversion: 2.20 time: 0.213937 Aug 24 15:44:35.949145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 411/820] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:35 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:36.980612 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:36.981320 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:36.989232 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:36.990619 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:36.991096 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:36.991809 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:36.992269 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:36.992694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:37.149586 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:37.160203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:37.162005 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:37.163498 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-bd228951-7cbe-4851-bef2-013caac71c38 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.187917 Aug 24 15:44:37.164420 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 410/821] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:36 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:38.189400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:38.189930 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:38.196853 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:38.197338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:38.197777 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:38.198470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:38.198957 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:38.199388 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:38.327131 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:38.336566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:38.338042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:38.339231 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-27170c5b-056b-4eeb-92dc-bd80fb3303a1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.153864 Aug 24 15:44:38.339791 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 412/822] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:38 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:39.368161 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:39.368566 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:39.372030 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.376379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:39.376862 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:39.377299 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:39.377992 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:39.378508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:39.378892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:39.517776 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:39.521778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:39.527695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:39.529172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:39.530342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3a87790d-d209-4a5c-a6c3-49bc9263c3a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.166255 Aug 24 15:44:39.530929 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 411/823] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:39 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:40.554825 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:40.568541 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:40.575309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:40.575789 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:40.576224 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:40.577193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:40.577470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:40.578068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:40.818285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:40.837185 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:40.838979 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:40.840211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3e577844-97b0-4290-88d5-2938b6e18013 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.290330 Aug 24 15:44:40.844664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 413/824] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:40 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:41.871236 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:41.871985 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:41.890963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:41.891465 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:41.891901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:41.892608 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:41.893052 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:41.893468 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:42.110836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:42.120786 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:42.122602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:42.124021 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-147da3fd-453f-4079-8fd1-905ac85e5103 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.257886 Aug 24 15:44:42.124777 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 412/825] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:41 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:43.149493 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:43.150102 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:43.159336 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:43.160307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:43.161302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:43.162606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:43.163407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:43.164082 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:43.352424 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:43.365670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:43.368523 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:43.370855 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c466d7ab-03d0-4a0d-89cf-99208cc89b83 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.225847 Aug 24 15:44:43.387902 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 414/826] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:43 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:44.396995 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:44.397973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:44.413646 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:44.414042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:44.414513 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:44.418765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:44.418765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:44.418765 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:44.564100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:44.573224 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:44.574783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:44.575962 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a3f4f272-ad49-4885-8b84-22e83012515f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.183000 Aug 24 15:44:44.576586 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 413/827] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:44 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:45.599012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:45.600380 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:45.607296 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:45.608040 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:45.608761 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:45.610072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:45.610893 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:45.611518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:45.840776 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:45.850365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:45.852382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:45.853756 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9c25b5cd-79fd-4b43-b8f1-c5693d18d638 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.258828 Aug 24 15:44:45.854841 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 415/828] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:45 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:46.878046 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:46.880125 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:46.888231 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:46.889061 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:46.889863 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:46.891042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:46.891773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:46.892473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:47.088466 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:47.100488 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:47.102708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:47.104617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-caa97c61-e376-4f5b-9090-f3ccb7786d01 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.230983 Aug 24 15:44:47.105955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 414/829] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:46 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:48.134563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:48.138061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:48.150359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:48.150869 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:48.151300 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:48.151995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:48.152442 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:48.155025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:48.375107 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:48.385162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:48.387085 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:48.388436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-897289dd-8c9b-463f-867d-19c1fb15f4fa tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.257795 Aug 24 15:44:48.403370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 416/830] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:48 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:49.415914 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:49.417552 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:49.428111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:49.428841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:49.429508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:49.430391 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:49.431092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:49.431689 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:49.628490 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:49.643262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:49.648708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:49.648708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d575a0bb-37e8-4975-8c10-96335191f8c9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.236470 Aug 24 15:44:49.651694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 415/831] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:49 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:50.677011 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:50.677615 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:50.684078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:50.684705 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:50.685147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:50.685843 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:50.686298 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:50.686785 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:50.827024 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:50.835851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:50.837359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:50.838533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e47a6d2f-dac5-4a69-99cb-4909eec9f0a4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.165777 Aug 24 15:44:50.839115 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 417/832] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:50 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:51.863099 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:51.863727 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:51.870139 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:51.870993 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:51.871537 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:51.872220 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:51.872700 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:51.873123 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:52.003051 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:52.012160 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:52.013674 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:52.014845 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e07c86e3-d9ba-4ba7-b778-d7d3615fe489 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.155575 Aug 24 15:44:52.015403 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 416/833] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:51 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:53.037564 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:53.038172 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:53.044599 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:53.045077 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:53.045508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:53.046190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:53.046664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:53.047100 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:53.182820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:53.191349 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:53.193452 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:53.194609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c563cea5-2ef3-461a-8c9b-6918df52fde9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.161199 Aug 24 15:44:53.195190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 418/834] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:53 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:54.217378 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:54.218024 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:54.224693 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:54.225173 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:54.225608 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:54.226561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:54.227043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:54.227467 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:54.362963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:54.373217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:54.374861 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:54.376053 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-27327a13-6675-4865-b600-b7ff76f6ecf6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.162670 Aug 24 15:44:54.376617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 417/835] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:54 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:55.400422 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:55.401195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:55.407337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:55.407811 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:55.408411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:55.409095 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:55.409672 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:55.410132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:55.567433 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:55.576303 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:55.577784 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:55.578966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0172b946-e97b-4b22-b6c2-805d441051a6 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.182480 Aug 24 15:44:55.579536 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 419/836] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:55 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:56.602712 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:56.603635 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:56.611089 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:56.611690 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:56.612347 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:56.613508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:56.613991 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:56.614422 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:56.758634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:56.769035 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:56.771740 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:56.773224 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-35927fe9-2d21-46cc-a116-946058edb09a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.175073 Aug 24 15:44:56.773787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 418/837] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:56 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:57.799007 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:57.799620 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:57.808555 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:57.809309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:57.809744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:57.810448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:57.810964 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:57.811391 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:57.979067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:58.008750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:58.012488 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:58.013991 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f352257a-329c-4552-92fa-664b441718b7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.220397 Aug 24 15:44:58.027430 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 420/838] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:57 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:59.039676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:59.040288 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:59.046929 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:59.047410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:59.047852 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:59.048540 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:59.048988 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:59.049411 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:59.190524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:59.199815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:59.201324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:59.202559 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-af41a8d5-b350-4a84-8d25-7ee5bf43a8fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.167026 Aug 24 15:44:59.203206 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 419/839] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:44:59 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:44:59.620575 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-511c6a46-db5a-42ef-bbe7-58011be05117 req-b419cfc6-03cb-4bbf-8c3a-18b559a3cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6562ed4a-9a9b-454e-a4fd-d0c2e7d19452", "name": "network-vif-plugged", "status": "completed", "tag": "d8aa5e82-99d7-4489-bc2f-7393036fdb8a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:59.633369 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-511c6a46-db5a-42ef-bbe7-58011be05117 req-b419cfc6-03cb-4bbf-8c3a-18b559a3cf3a service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:59.633900 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-511c6a46-db5a-42ef-bbe7-58011be05117 req-b419cfc6-03cb-4bbf-8c3a-18b559a3cf3a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:59.634656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-511c6a46-db5a-42ef-bbe7-58011be05117 req-b419cfc6-03cb-4bbf-8c3a-18b559a3cf3a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:59.647399 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-511c6a46-db5a-42ef-bbe7-58011be05117 req-b419cfc6-03cb-4bbf-8c3a-18b559a3cf3a service nova] Creating event network-vif-plugged:d8aa5e82-99d7-4489-bc2f-7393036fdb8a for instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 on hv-cinder-84605 Aug 24 15:44:59.652467 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-511c6a46-db5a-42ef-bbe7-58011be05117 req-b419cfc6-03cb-4bbf-8c3a-18b559a3cf3a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035421 Aug 24 15:44:59.653057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 421/840] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:00.229341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:00.229965 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:00.237039 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:00.237522 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:00.237998 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:00.238778 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:00.239292 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:00.239720 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:00.391525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:00.401617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:00.403212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:00.404492 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a7aae0d7-76e7-409c-9de5-9c5459232267 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.181117 Aug 24 15:45:00.405098 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 420/841] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:00 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:01.432444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:01.433083 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:01.439924 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:01.440420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:01.440861 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:01.441750 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:01.442456 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:01.442916 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:01.588743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:01.598597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:01.600208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:01.601645 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1c237ed6-f6fc-42de-ad16-d62a55678366 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1808 microversion: 2.20 time: 0.174283 Aug 24 15:45:01.602219 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 422/842] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:01 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:02.625764 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:02.626289 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:02.633158 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:02.633641 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:02.634074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:02.634800 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:02.635256 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:02.635679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:02.766287 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:02.777265 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:02.778788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:02.779945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0dea8ff4-21a0-4679-b311-2a35790f1947 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1795 microversion: 2.20 time: 0.158308 Aug 24 15:45:02.780505 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 421/843] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:02 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:35.489393 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:35.490049 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:35.492333 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=27 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.492982 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=64 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.499487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:35.499979 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:35.500412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:35.501104 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:35.501560 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:35.501983 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:35.530943 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f71e3886-5082-4cd7-b86a-2c1b7acf376b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments/5d92e869-1568-4853-972c-9646491149d8" status: 200 len: 194 microversion: 2.20 time: 0.046021 Aug 24 15:45:35.531526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 423/844] 10.222.0.73 () {60 vars in 1454 bytes} [Wed Aug 24 15:45:35 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments/5d92e869-1568-4853-972c-9646491149d8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:35.598675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:35.599194 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:35.601634 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=21 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.602462 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=60 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.607772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:35.608252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:35.608683 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:35.609374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:35.609826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:35.610252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:35.689141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lazy-loading 'services' on Instance uuid 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:45:35.759912 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-881a8757-5479-4aa7-aacc-db478e4055bf tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments/5d92e869-1568-4853-972c-9646491149d8" status: 202 len: 0 microversion: 2.20 time: 0.165046 Aug 24 15:45:35.760501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 422/845] 10.222.0.73 () {60 vars in 1457 bytes} [Wed Aug 24 15:45:35 2022] DELETE /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments/5d92e869-1568-4853-972c-9646491149d8 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:45:35.769629 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:35.771833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:35.778185 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:35.778768 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:35.779245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:35.780246 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:35.781386 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:35.781814 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:35.815057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a6d05cbc-13d9-45dd-b19e-35e24f454823 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049979 Aug 24 15:45:35.815610 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 424/846] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 15:45:35 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:36.829020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:36.831390 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:36.838185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:36.838694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:36.839135 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:36.839820 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:36.840270 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:36.840690 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:36.886713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3fe8733c-18f4-4518-b1ed-fc4927786c3d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062510 Aug 24 15:45:36.887267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 423/847] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 15:45:36 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:45:36.948852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:36.949396 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:36.955705 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:36.956187 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:36.956619 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:36.957321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:36.957764 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:36.958197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:36.983152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Going to try to terminate instance {{(pid=132289) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:45:37.060015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1a0b667a-4ad4-478f-b68f-5f719ede3af4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 204 len: 0 microversion: 2.20 time: 0.114930 Aug 24 15:45:37.060655 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 425/848] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 15:45:36 2022] DELETE /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 15:45:37.070781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:37.071384 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:37.077240 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:37.077720 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:37.078151 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:37.078864 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:37.079317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:37.079734 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:37.207052 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:37.215508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:37.217013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:37.218180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b4c72741-f6ec-47bc-b4a2-707e4bc5522e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.152991 Aug 24 15:45:37.218771 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 424/849] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:37 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:38.242465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:38.243193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:38.249503 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:38.249981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:38.250412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:38.251135 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:38.251586 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:38.252008 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:38.381685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:38.389765 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:38.391298 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:38.392482 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-85f0392a-2c11-4cd6-b2e0-5ff32e114135 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1723 microversion: 2.20 time: 0.154796 Aug 24 15:45:38.393034 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 426/850] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:38 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:39.416785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:39.417401 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:39.423949 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:39.424580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:39.425020 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:39.425713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:39.426218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:39.426671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:39.493055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:39.501499 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:39.503056 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:39.504779 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ef75fd6c-906e-4eb7-938a-7dc8449ca529 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 200 len: 1655 microversion: 2.20 time: 0.091473 Aug 24 15:45:39.505344 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 425/851] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:39 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:39.659914 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-34b5ecec-9ee8-48d2-94cb-390e92d076f0 req-b59e83c6-0f3a-4019-b579-3bcca4d44cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6562ed4a-9a9b-454e-a4fd-d0c2e7d19452", "name": "network-vif-deleted", "tag": "d8aa5e82-99d7-4489-bc2f-7393036fdb8a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:39.670014 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-34b5ecec-9ee8-48d2-94cb-390e92d076f0 req-b59e83c6-0f3a-4019-b579-3bcca4d44cbd service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:39.670488 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-34b5ecec-9ee8-48d2-94cb-390e92d076f0 req-b59e83c6-0f3a-4019-b579-3bcca4d44cbd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:39.670950 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-34b5ecec-9ee8-48d2-94cb-390e92d076f0 req-b59e83c6-0f3a-4019-b579-3bcca4d44cbd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:39.685078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-34b5ecec-9ee8-48d2-94cb-390e92d076f0 req-b59e83c6-0f3a-4019-b579-3bcca4d44cbd service nova] Creating event network-vif-deleted:d8aa5e82-99d7-4489-bc2f-7393036fdb8a for instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 on hv-cinder-84605 Aug 24 15:45:39.690046 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-34b5ecec-9ee8-48d2-94cb-390e92d076f0 req-b59e83c6-0f3a-4019-b579-3bcca4d44cbd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033832 Aug 24 15:45:39.690716 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 427/852] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:40.527790 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:40.528426 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:40.534933 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:40.535557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:40.535886 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:40.536672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:40.537159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:40.537590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:40.551579 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] HTTP exception thrown: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Request method failure captured: Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 HTTP/1.1 Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkb5e95KtXgutmtifS8UQCNKy8bY6-CtzgV_2osmqQto6e_BDI3cwtbbjhu6m4vo6dBK6tAMJQ2PKP9VQRn198aiR5f77YV2ePvKFs_gM6TcxH3fdr1yFp7vIliSWhGq7W4B7w5TPc5fp-9ekzRl4Qbg5jtCfwS37VmtENn7ja9W8Rk Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:45:40.553317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9b9728b1ee454013a3968c27080cd98c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9b9728b1ee454013a3968c27080cd98c"}]}] Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: e02f332ba23a4a3cacb99f5c69a5b524 Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:45:40.555154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '6562ed4a-9a9b-454e-a4fd-d0c2e7d19452'} Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:45:40.556111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:45:40.557898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:45:40.559533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Returning 404 to user: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:45:40.559533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a6b8028e-c698-4bad-87d2-47838dd65766 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 404 len: 111 microversion: 2.20 time: 0.030890 Aug 24 15:45:40.559533 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 426/853] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:40 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:45:40.564283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-080b03e2-591a-4a5e-84e7-d951fbb52d88 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '.version_select at 0x7f07905321f0>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:40.586242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-080b03e2-591a-4a5e-84e7-d951fbb52d88 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-83946513" status: 204 len: 0 microversion: 2.20 time: 0.026049 Aug 24 15:45:40.586852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 428/854] 10.222.0.73 () {60 vars in 1256 bytes} [Wed Aug 24 15:45:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-83946513 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 15:45:41.245017 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c2068eba-bfbe-4c21-94fa-51267e40f702 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'create', calling method: .version_select at 0x7f07834f1c10>, body: {"keypair": {"name": "tempest-keypair-717375917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzu2MFkHsnvKEWxhEciCAK5yYPQ8JB1gX5Up/o8BSGGwu5YAITwiwhs4bSH4QWEIOJ2HtK3aYEUbIaEZsk9DU3xATnZCL0LDLKfsdk2ugvbBsy/lSK2db/7usTK5aYa5w=="}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:41.260316 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-c2068eba-bfbe-4c21-94fa-51267e40f702 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for project 9b9728b1ee454013a3968c27080cd98c. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:45:41.264118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-c2068eba-bfbe-4c21-94fa-51267e40f702 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for user e02f332ba23a4a3cacb99f5c69a5b524 and project 9b9728b1ee454013a3968c27080cd98c. Resources: {'key_pairs'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:45:41.286113 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c2068eba-bfbe-4c21-94fa-51267e40f702 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044506 Aug 24 15:45:41.286722 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 427/855] 10.222.0.73 () {62 vars in 1200 bytes} [Wed Aug 24 15:45:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 15:45:42.549916 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1957887156", "imageRef": "7d1c208a-0215-4b56-86a2-3abfac2cbc07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7978ebbc-163a-4438-8674-44dc5d815bb0"}], "security_groups": [{"name": "tempest-securitygroup--1505533648"}], "key_name": "tempest-keypair-717375917", "user_data": "}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:42.655397 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.network.neutron [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] validate_networks() for [('7978ebbc-163a-4438-8674-44dc5d815bb0', None, None, None, None, None)] {{(pid=132289) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:45:43.160277 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Flavor limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:45:43.161256 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Image limits 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:45:43.161721 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Flavor pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:45:43.162118 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Image pref 0:0:0 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:45:43.162580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.virt.hardware [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:45:43.172032 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:43.172636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:43.173139 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:43.173855 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:43.174302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:43.174743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:43.191171 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for project 9b9728b1ee454013a3968c27080cd98c. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:45:43.195258 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.quota [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Getting quotas for user e02f332ba23a4a3cacb99f5c69a5b524 and project 9b9728b1ee454013a3968c27080cd98c. Resources: {'instances', 'ram', 'cores'} {{(pid=132289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:45:43.206027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Going to run 1 instances... {{(pid=132289) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:45:43.210023 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7d1c208a-0215-4b56-86a2-3abfac2cbc07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:45:43.260054 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-e549916b-6919-43bb-8e11-a433f7babad7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.714961 Aug 24 15:45:43.260881 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 429/856] 10.222.0.73 () {62 vars in 1188 bytes} [Wed Aug 24 15:45:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 15:45:43.272885 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e335b2c2-0e9d-4ac7-9d1c-b916e6ee8473 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:43.273484 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e335b2c2-0e9d-4ac7-9d1c-b916e6ee8473 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:43.329769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e335b2c2-0e9d-4ac7-9d1c-b916e6ee8473 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:43.338327 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e335b2c2-0e9d-4ac7-9d1c-b916e6ee8473 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:43.339876 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e335b2c2-0e9d-4ac7-9d1c-b916e6ee8473 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:43.340982 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e335b2c2-0e9d-4ac7-9d1c-b916e6ee8473 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1281 microversion: 2.20 time: 0.073150 Aug 24 15:45:43.350907 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 428/857] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:43 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:44.364794 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:44.365525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:44.371945 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:44.372431 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:44.372869 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:44.373559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:44.374011 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:44.374442 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:44.452037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:44.460867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:44.462425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:44.463799 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-726163e9-9ad2-4581-b5d8-12360ef18807 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1339 microversion: 2.20 time: 0.104150 Aug 24 15:45:44.464360 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 430/858] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:44 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:45.487025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:45.487657 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:45.494676 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:45.495177 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:45.495614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:45.496318 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:45.496774 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:45.497198 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:45.631651 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:45.639852 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:45.641441 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:45.642571 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6b6a9aa7-01c6-4950-b445-2c2ea465d5d1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1407 microversion: 2.20 time: 0.159759 Aug 24 15:45:45.643183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 429/859] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:45 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:45.817429 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-a1d8a5eb-91ec-40bf-8316-4e77e25e0c66 req-ec46e71c-a52b-4dff-b09b-a6bb19d9d1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fcadfb-256c-4fae-91da-92e0acab0eb4", "tag": "971907b7-0cc7-45df-b21d-aeb0f809428b"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:45.830281 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-a1d8a5eb-91ec-40bf-8316-4e77e25e0c66 req-ec46e71c-a52b-4dff-b09b-a6bb19d9d1fd service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:45.830792 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-a1d8a5eb-91ec-40bf-8316-4e77e25e0c66 req-ec46e71c-a52b-4dff-b09b-a6bb19d9d1fd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:45.831220 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-a1d8a5eb-91ec-40bf-8316-4e77e25e0c66 req-ec46e71c-a52b-4dff-b09b-a6bb19d9d1fd service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:45.846603 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-a1d8a5eb-91ec-40bf-8316-4e77e25e0c66 req-ec46e71c-a52b-4dff-b09b-a6bb19d9d1fd service nova] Creating event network-changed:971907b7-0cc7-45df-b21d-aeb0f809428b for instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 on hv-cinder-84605 Aug 24 15:45:45.852823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-a1d8a5eb-91ec-40bf-8316-4e77e25e0c66 req-ec46e71c-a52b-4dff-b09b-a6bb19d9d1fd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039988 Aug 24 15:45:45.853433 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 431/860] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:46.665602 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:46.666232 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:46.672687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:46.673171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:46.673624 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:46.674295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:46.674781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:46.675209 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:46.808844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:46.817711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:46.819244 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:46.820350 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c0ee6da5-4e0c-46c1-8e29-9b89320a9761 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1407 microversion: 2.20 time: 0.158818 Aug 24 15:45:46.820914 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 430/861] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:46 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:45:47.842623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:47.843279 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:47.850173 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:47.850933 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:47.851374 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:47.852060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:47.852638 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:47.853069 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:47.981925 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:47.990165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:47.991697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:47.992801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8427b8e4-ab7f-4c6d-99d9-56ea32536df9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1407 microversion: 2.20 time: 0.154583 Aug 24 15:45:47.993361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 432/862] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:47 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:49.018769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:49.022335 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:49.027033 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:49.027522 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:49.027956 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:49.028656 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:49.029107 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:49.029526 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:49.161323 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:49.169590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:49.171375 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:49.172474 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-fff968bb-be7e-4b58-acf1-96ebbeb941ec tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1407 microversion: 2.20 time: 0.159616 Aug 24 15:45:49.173029 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 431/863] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:49 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:45:50.195780 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:50.196389 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:50.202548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:50.203059 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:50.203482 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:50.204166 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:50.204617 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:50.205044 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:50.342743 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:50.351203 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:50.352699 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:50.353804 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3d8753d8-12fc-46da-ae64-60fa793ae9f4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1407 microversion: 2.20 time: 0.162788 Aug 24 15:45:50.354359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 433/864] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:50 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:51.378323 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:51.379525 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:51.390483 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:51.391004 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:51.391473 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:51.392184 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:51.392642 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:51.393074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:51.543082 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:51.553562 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:51.555943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:51.557629 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c8022a41-a7d4-4260-bb4b-2674dcb32fcb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1407 microversion: 2.20 time: 0.184315 Aug 24 15:45:51.558341 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 432/865] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:51 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:51.942504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-39a5f84f-50b6-4170-b186-1c5539cb6344 req-87b6c922-43f5-4732-8ed8-9f2a0c6a3110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fcadfb-256c-4fae-91da-92e0acab0eb4", "name": "network-vif-plugged", "status": "completed", "tag": "971907b7-0cc7-45df-b21d-aeb0f809428b"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:51.953354 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-39a5f84f-50b6-4170-b186-1c5539cb6344 req-87b6c922-43f5-4732-8ed8-9f2a0c6a3110 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:51.953828 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-39a5f84f-50b6-4170-b186-1c5539cb6344 req-87b6c922-43f5-4732-8ed8-9f2a0c6a3110 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:51.954255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-39a5f84f-50b6-4170-b186-1c5539cb6344 req-87b6c922-43f5-4732-8ed8-9f2a0c6a3110 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:51.966136 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-39a5f84f-50b6-4170-b186-1c5539cb6344 req-87b6c922-43f5-4732-8ed8-9f2a0c6a3110 service nova] Creating event network-vif-plugged:971907b7-0cc7-45df-b21d-aeb0f809428b for instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 on hv-cinder-84605 Aug 24 15:45:51.971457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-39a5f84f-50b6-4170-b186-1c5539cb6344 req-87b6c922-43f5-4732-8ed8-9f2a0c6a3110 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032437 Aug 24 15:45:51.972241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 434/866] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:52.580849 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:52.581383 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:52.588410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:52.588895 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:52.589335 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:52.590026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:52.590488 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:52.590940 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:52.722458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:52.731018 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:52.732521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:52.733627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-17ce9d0d-c523-4c36-b22a-e12e57bc1ee1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1407 microversion: 2.20 time: 0.156797 Aug 24 15:45:52.734190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 433/867] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:52 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:53.755271 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:53.756273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=6 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:53.761181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:53.761866 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:53.769895 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:53.771005 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:53.771439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:53.772524 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:53.773005 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:53.773434 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:53.906577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:53.914731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:53.916212 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:45:53.917346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d5ca4437-fc47-4f42-b3c3-332657532c40 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1598 microversion: 2.20 time: 0.164770 Aug 24 15:45:53.917939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 435/868] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:45:53 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:45:53.939298 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:53.939805 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:53.941766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:53.948521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:53.949013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:53.949502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:53.950264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:53.950742 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:53.951165 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:54.027858 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0a855da4-efa5-4ecf-80a0-785ceb31f3c8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092313 Aug 24 15:45:54.028448 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 434/869] 10.222.0.73 () {60 vars in 1316 bytes} [Wed Aug 24 15:45:53 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:45:55.199592 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-449b4bb1-584d-4f4e-9e33-e129ec93547f req-149fdf76-868d-4bfd-a218-4a52ab8f8aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fcadfb-256c-4fae-91da-92e0acab0eb4", "tag": "971907b7-0cc7-45df-b21d-aeb0f809428b"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:55.210446 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-449b4bb1-584d-4f4e-9e33-e129ec93547f req-149fdf76-868d-4bfd-a218-4a52ab8f8aa8 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:55.211028 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-449b4bb1-584d-4f4e-9e33-e129ec93547f req-149fdf76-868d-4bfd-a218-4a52ab8f8aa8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:55.211517 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-449b4bb1-584d-4f4e-9e33-e129ec93547f req-149fdf76-868d-4bfd-a218-4a52ab8f8aa8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:55.222430 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-449b4bb1-584d-4f4e-9e33-e129ec93547f req-149fdf76-868d-4bfd-a218-4a52ab8f8aa8 service nova] Creating event network-changed:971907b7-0cc7-45df-b21d-aeb0f809428b for instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 on hv-cinder-84605 Aug 24 15:45:55.227782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-449b4bb1-584d-4f4e-9e33-e129ec93547f req-149fdf76-868d-4bfd-a218-4a52ab8f8aa8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031831 Aug 24 15:45:55.228768 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 436/870] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:06.817284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:06.818118 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:06.822238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:06.822767 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:06.830371 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:06.831101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:06.831541 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:06.832241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:06.832696 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:06.833147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:06.858662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:46:06.934942 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7a24ed8d-b289-4bbe-bf24-048e01a275d1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 204 len: 0 microversion: 2.1 time: 0.119415 Aug 24 15:46:06.935521 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 435/871] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:46:06 2022] DELETE /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:46:06.942154 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:06.942939 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:06.947632 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:06.948449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:06.957951 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:06.958538 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:06.959003 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:06.959696 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:06.960145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:06.960567 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:07.092307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:07.100649 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-27ce8c7c-58e9-42e3-8223-a435a6ad958b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1578 microversion: 2.1 time: 0.160487 Aug 24 15:46:07.101298 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 437/872] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:06 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:08.123019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:08.123713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:08.130138 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:08.130616 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:08.131078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:08.131760 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:08.132208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:08.132622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:08.266386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:08.274839 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cea12d40-fb8b-41bf-9843-61d55c3fb2f9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1578 microversion: 2.1 time: 0.155990 Aug 24 15:46:08.275421 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 436/873] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:08 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:09.297663 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:09.298424 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:09.305734 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:09.306218 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:09.306664 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:09.307400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:09.307848 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:09.308283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:09.374089 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:09.382416 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-05c5ef6e-cafc-453a-9e4a-88676b119c3b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 200 len: 1511 microversion: 2.1 time: 0.089637 Aug 24 15:46:09.383108 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 438/874] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:09 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:09.529785 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-6fa8a17a-9b95-4d05-afc4-8d96ec7a6adf req-65900f3c-c317-416a-96bd-63e7e6c6aeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2939b24d-ed1a-4b5f-85c7-ba39b537afd2", "name": "network-vif-deleted", "tag": "f082148e-fa4f-49a1-806d-e56c40305abb"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:09.541400 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6fa8a17a-9b95-4d05-afc4-8d96ec7a6adf req-65900f3c-c317-416a-96bd-63e7e6c6aeb2 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:09.541894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6fa8a17a-9b95-4d05-afc4-8d96ec7a6adf req-65900f3c-c317-416a-96bd-63e7e6c6aeb2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:09.542326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6fa8a17a-9b95-4d05-afc4-8d96ec7a6adf req-65900f3c-c317-416a-96bd-63e7e6c6aeb2 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:09.553894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-6fa8a17a-9b95-4d05-afc4-8d96ec7a6adf req-65900f3c-c317-416a-96bd-63e7e6c6aeb2 service nova] Creating event network-vif-deleted:f082148e-fa4f-49a1-806d-e56c40305abb for instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 on hv-cinder-84605 Aug 24 15:46:09.559201 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-6fa8a17a-9b95-4d05-afc4-8d96ec7a6adf req-65900f3c-c317-416a-96bd-63e7e6c6aeb2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033097 Aug 24 15:46:09.562711 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 437/875] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:10.403685 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:10.404293 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:10.410909 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:10.411577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:10.412012 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:10.412707 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:10.413161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:10.413587 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:10.427486 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] HTTP exception thrown: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Request method failure captured: Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 HTTP/1.1 Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkcKYPuYAlY_9hdX7fdS8MdabQt7eYRPCmUBHTtip-4eoPHfH7QKVyccAJfrJg4RPghpk9yBze894W52Cu0s4Qd7M5kMKXu188J3Z-xN_KHErov0AKsaZX0zI63-licsc2ZyCetPBS40qYa1oqTu_jPuzHgW9WXXCSJbI6Nr87OMdAY Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:46:10.429145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b496441965834f65a8d0813e8221c685", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b496441965834f65a8d0813e8221c685"}]}] Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 81be4c83d3b04624ae11bcbf37a44309 Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:46:10.430899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '2939b24d-ed1a-4b5f-85c7-ba39b537afd2'} Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:46:10.440322 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:46:10.443782 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:46:10.445233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Returning 404 to user: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:46:10.445233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2fdf7100-001f-4921-bc5f-45170f8350b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 404 len: 111 microversion: 2.1 time: 0.030967 Aug 24 15:46:10.445233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 439/876] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:10 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:46:10.533826 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1229623467", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-292842636", "security_groups": [{"name": "tempest-secgroup-smoke-514253164"}], "block_device_mapping_v2": [{"uuid": "7627d83d-173b-4e73-a422-99f87326bb99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55e08d2e-d6cb-4529-86e4-566ae8e28cc6"}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:10.650672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] validate_networks() for [('55e08d2e-d6cb-4529-86e4-566ae8e28cc6', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:46:11.016063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:46:11.016485 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:46:11.016959 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:46:11.017369 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:46:11.017777 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:46:11.027211 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:11.027688 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:11.028121 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:11.028842 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:11.029295 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:11.029715 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:11.046844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for project b496441965834f65a8d0813e8221c685. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:46:11.050835 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for user 81be4c83d3b04624ae11bcbf37a44309 and project b496441965834f65a8d0813e8221c685. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:46:11.107236 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:46:11.109449 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7627d83d-173b-4e73-a422-99f87326bb99',volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:46:11.235902 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-1236f16e-44f2-4a63-a102-ee832d62275f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.706305 Aug 24 15:46:11.236617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 438/877] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:46:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:46:11.248274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3277a9ff-f95d-488a-a9fa-da3a3350e6b3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:11.248889 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3277a9ff-f95d-488a-a9fa-da3a3350e6b3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:11.305572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-3277a9ff-f95d-488a-a9fa-da3a3350e6b3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:11.314211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3277a9ff-f95d-488a-a9fa-da3a3350e6b3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1094 microversion: 2.1 time: 0.069734 Aug 24 15:46:11.315158 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 440/878] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:11 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:12.338508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:12.339155 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:12.348070 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:12.348913 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:12.349431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:12.350633 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:12.351752 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:12.352617 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:12.427596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:12.435432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e51e0950-32a3-4c56-87dc-1c1aa5f269f6 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1210 microversion: 2.1 time: 0.103577 Aug 24 15:46:12.436010 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 439/879] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:12 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:13.457067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:13.457677 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:13.468921 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:13.469424 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:13.469885 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:13.470577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:13.471069 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:13.471502 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:13.558080 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-6cbad084-8490-4042-8d89-a8ac8b7162e5 req-0f6d582f-ec54-4605-b087-5315a57007c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877b318e-d10f-47a2-b221-5b5d23400aa9", "tag": "c494b458-5e21-4458-a860-36829d3f0f6b"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:13.570836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6cbad084-8490-4042-8d89-a8ac8b7162e5 req-0f6d582f-ec54-4605-b087-5315a57007c3 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:13.571467 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6cbad084-8490-4042-8d89-a8ac8b7162e5 req-0f6d582f-ec54-4605-b087-5315a57007c3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:13.572148 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-6cbad084-8490-4042-8d89-a8ac8b7162e5 req-0f6d582f-ec54-4605-b087-5315a57007c3 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:13.583673 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-6cbad084-8490-4042-8d89-a8ac8b7162e5 req-0f6d582f-ec54-4605-b087-5315a57007c3 service nova] Creating event network-changed:c494b458-5e21-4458-a860-36829d3f0f6b for instance 877b318e-d10f-47a2-b221-5b5d23400aa9 on hv-cinder-84605 Aug 24 15:46:13.588853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-6cbad084-8490-4042-8d89-a8ac8b7162e5 req-0f6d582f-ec54-4605-b087-5315a57007c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034726 Aug 24 15:46:13.589763 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 440/880] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:13.619530 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:13.627539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-9299daeb-2e98-40b0-8831-fc31194a0daa tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.174318 Aug 24 15:46:13.628190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 441/881] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:13 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:14.649987 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:14.650790 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:14.657110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:14.657591 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:14.658015 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:14.658809 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:14.659262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:14.659703 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:14.794814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:14.803561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-53bd121a-1627-4282-bc6a-576516c81fde tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.158133 Aug 24 15:46:14.804152 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 441/882] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:14 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:15.824612 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:15.825217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:15.831616 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:15.832774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:15.833280 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:15.833969 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:15.834425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:15.834882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:15.969106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:15.977015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5601eec4-8705-4c6f-bb7a-becde29a3352 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.156213 Aug 24 15:46:15.977577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 442/883] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:15 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:16.997709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:16.998359 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:17.005241 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:17.005727 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:17.006168 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:17.006892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:17.007355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:17.007780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:17.139882 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:17.148381 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-dd83f863-fe73-4bd9-a203-7c09bc8040b7 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.154663 Aug 24 15:46:17.148947 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 442/884] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:16 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:18.169514 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:18.170098 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:18.176862 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:18.177346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:18.177814 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:18.178526 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:18.179015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:18.179438 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:18.312103 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:18.320720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c1fe6183-ba8e-4c09-8c9c-4ba3fcaa8699 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.154976 Aug 24 15:46:18.321498 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 443/885] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:18 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:19.341614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:19.342188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:19.349594 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:19.350084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:19.350806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:19.351555 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:19.352011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:19.352437 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:19.488312 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:19.496197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-be9e3283-1edf-4d17-a119-071d95fbe551 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.158609 Aug 24 15:46:19.496761 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 443/886] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:19 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:20.516974 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:20.517643 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:20.524071 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:20.524537 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:20.524964 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:20.525646 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:20.526093 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:20.526514 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:20.657444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:20.665552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-eb542668-69f4-4482-864a-2ec8ef721287 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.152493 Aug 24 15:46:20.666108 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 444/887] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:20 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:21.686774 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:21.687379 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:21.689794 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:21.690574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:21.696723 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:21.697203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:21.697645 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:21.698304 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:21.698789 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:21.699207 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:21.837166 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:21.844869 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9e69be90-42c8-45e2-948d-a4d4534f328b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.162016 Aug 24 15:46:21.845427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 444/888] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:21 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:22.865119 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:22.865725 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:22.867569 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:22.873138 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:22.873623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:22.874061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:22.874790 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:22.875245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:22.875668 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:23.007488 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:23.015563 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6859c238-9c08-440e-ac81-9d5f6924cb33 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.154897 Aug 24 15:46:23.016370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 445/889] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:22 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:24.038935 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:24.039615 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:24.046104 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:24.046590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:24.047092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:24.047793 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:24.048248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:24.048672 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:24.093395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-695ef6fe-2319-4862-858a-38f2009dd328 req-c1fcd091-541a-4038-a9ad-48650c05feda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877b318e-d10f-47a2-b221-5b5d23400aa9", "name": "network-vif-plugged", "status": "completed", "tag": "c494b458-5e21-4458-a860-36829d3f0f6b"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:24.104434 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-695ef6fe-2319-4862-858a-38f2009dd328 req-c1fcd091-541a-4038-a9ad-48650c05feda service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:24.105195 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-695ef6fe-2319-4862-858a-38f2009dd328 req-c1fcd091-541a-4038-a9ad-48650c05feda service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:24.105623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-695ef6fe-2319-4862-858a-38f2009dd328 req-c1fcd091-541a-4038-a9ad-48650c05feda service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:24.119558 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-695ef6fe-2319-4862-858a-38f2009dd328 req-c1fcd091-541a-4038-a9ad-48650c05feda service nova] Creating event network-vif-plugged:c494b458-5e21-4458-a860-36829d3f0f6b for instance 877b318e-d10f-47a2-b221-5b5d23400aa9 on hv-cinder-84605 Aug 24 15:46:24.124539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-695ef6fe-2319-4862-858a-38f2009dd328 req-c1fcd091-541a-4038-a9ad-48650c05feda service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035344 Aug 24 15:46:24.125132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 446/890] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:24.195546 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:24.203238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-2ccd3641-8f26-47b1-9fd1-bc333a675cee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.168389 Aug 24 15:46:24.203798 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 445/891] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:24 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:25.225067 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:25.226019 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:25.232144 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:25.232625 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:25.233060 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:25.233755 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:25.234210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:25.234635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:25.368522 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:25.376264 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-be05bf83-27ed-4081-a6f9-196ae94a7e15 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1265 microversion: 2.1 time: 0.155983 Aug 24 15:46:25.382527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 447/892] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:25 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:26.397410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:26.398022 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:26.404504 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:26.404992 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:26.405431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:26.406126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:26.406583 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:26.407041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:26.543963 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:26.552591 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a82ead07-455a-478b-927d-a41fa8205095 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1452 microversion: 2.1 time: 0.159942 Aug 24 15:46:26.553155 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 446/893] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:26 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:26.572197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:26.572799 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:26.579597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:26.580021 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:26.580454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:26.581147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:26.581701 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:26.582206 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:26.714498 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:26.722877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-47160dcf-2c35-4df4-ba9c-457602160a5b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1452 microversion: 2.1 time: 0.153890 Aug 24 15:46:26.723451 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 448/894] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:26 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:46:28.291122 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-41fcb0be-7332-4e73-a5d4-0d67ca05a299 req-9a858370-3dcf-49f1-879c-e3df48d35511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877b318e-d10f-47a2-b221-5b5d23400aa9", "tag": "c494b458-5e21-4458-a860-36829d3f0f6b"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:28.302087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-41fcb0be-7332-4e73-a5d4-0d67ca05a299 req-9a858370-3dcf-49f1-879c-e3df48d35511 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:28.302574 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-41fcb0be-7332-4e73-a5d4-0d67ca05a299 req-9a858370-3dcf-49f1-879c-e3df48d35511 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:28.303051 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-41fcb0be-7332-4e73-a5d4-0d67ca05a299 req-9a858370-3dcf-49f1-879c-e3df48d35511 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:28.314626 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-41fcb0be-7332-4e73-a5d4-0d67ca05a299 req-9a858370-3dcf-49f1-879c-e3df48d35511 service nova] Creating event network-changed:c494b458-5e21-4458-a860-36829d3f0f6b for instance 877b318e-d10f-47a2-b221-5b5d23400aa9 on hv-cinder-84605 Aug 24 15:46:28.320952 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-41fcb0be-7332-4e73-a5d4-0d67ca05a299 req-9a858370-3dcf-49f1-879c-e3df48d35511 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033549 Aug 24 15:46:28.321558 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 447/895] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:31.168907 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:31.169472 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:31.175924 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:31.176395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:31.176821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:31.177533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:31.177987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:31.178400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:31.201327 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7b7ad7a6-ab8f-4b98-8c3a-8a8407675415 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/ips" status: 200 len: 151 microversion: 2.20 time: 0.036386 Aug 24 15:46:31.201874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 449/896] 10.222.0.73 () {60 vars in 1289 bytes} [Wed Aug 24 15:46:31 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:46:33.590847 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:33.591460 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:33.598180 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:33.598707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:33.599142 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:33.599828 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:33.600278 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:33.600966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:33.622841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.objects.instance [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lazy-loading 'flavor' on Instance uuid c2fcadfb-256c-4fae-91da-92e0acab0eb4 {{(pid=132288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:46:33.798019 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-43cd3ec7-b1cc-442f-9f38-5562525b4fef tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/action" status: 202 len: 0 microversion: 2.20 time: 0.211994 Aug 24 15:46:33.798610 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 448/897] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 15:46:33 2022] POST /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:46:33.806840 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:33.807454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:33.814601 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:33.815294 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:33.815774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:33.816472 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:33.816923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:33.817353 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:33.956024 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:33.965048 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:33.967319 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:33.969048 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c9d85ee1-b3f1-445f-abb3-b3a5d2d50e81 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.165549 Aug 24 15:46:33.969638 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 450/898] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:33 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:34.993693 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:34.994387 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:35.000596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:35.001107 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:35.001542 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:35.002227 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:35.002699 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:35.003252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:35.132413 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:35.140629 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:35.142174 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:35.143370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-bdff2b84-c558-45d6-97f2-5a292c975b5b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.154494 Aug 24 15:46:35.144453 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 449/899] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:34 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:36.166571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:36.167209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:36.173687 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:36.174170 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:36.174602 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:36.175359 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:36.175821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:36.176268 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:36.307862 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:36.316854 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:36.318384 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:36.319582 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-067bab0a-d38b-4c14-b741-7d408c9acaa1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.156936 Aug 24 15:46:36.320142 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 451/900] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:36 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:37.345432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:37.346034 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:37.348780 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:37.354213 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:37.354708 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:37.355142 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:37.355821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:37.356264 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:37.356679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:37.360001 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:37.488926 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:37.496943 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:37.498463 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:37.499630 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ad007812-8b1f-4e3f-87dc-4764bdd3fa59 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.160641 Aug 24 15:46:37.500188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 450/901] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:37 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:38.521411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:38.522038 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:38.524536 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=33 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:38.529672 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:38.530157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:38.530588 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:38.531295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:38.531747 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:38.532165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:38.535411 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=75 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:38.661693 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:38.669722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:38.671243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:38.672395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1ba7182c-ce68-4be0-9180-a9599fe9c26c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.154987 Aug 24 15:46:38.672974 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 452/902] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:38 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:39.695784 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:39.696338 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:39.702665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:39.703141 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:39.703566 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:39.704240 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:39.704691 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:39.705105 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:39.837892 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:39.846124 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:39.848496 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:39.849660 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-8468534c-0bda-4b80-a8aa-b949ae7fbb87 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.157898 Aug 24 15:46:39.850221 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 451/903] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:39 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:46:40.873330 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:40.873968 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:40.879971 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:40.880445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:40.880877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:40.881575 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:40.882035 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:40.882454 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:41.012677 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:41.020694 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:41.022193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:41.023382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-218d44ce-74b6-4142-a89d-8b808ebf31c5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.154145 Aug 24 15:46:41.023940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 453/904] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:40 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:42.046435 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:42.047073 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:42.054303 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:42.054817 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:42.055257 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:42.055950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:42.056404 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:42.056827 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:42.186822 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:42.195223 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:42.196719 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:42.197880 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-14861575-3f62-4305-984f-4418b539ab77 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.155364 Aug 24 15:46:42.198432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 452/905] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:42 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:43.220396 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:43.220999 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:43.228346 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:43.228818 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:43.229245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:43.229923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:43.230370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:43.230821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:43.365382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:43.373445 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:43.374960 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:43.376108 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a1e00c3a-f988-4301-b355-9e2715e0dffb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.159617 Aug 24 15:46:43.376669 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 454/906] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:43 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:44.398775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:44.399386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:44.406941 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:44.407373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:44.407806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:44.408501 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:44.408953 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:44.409374 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:44.542453 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:44.550906 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:44.552938 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:44.554079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-6257cc2e-ad32-42a8-9a91-c91fb1d79749 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1744 microversion: 2.20 time: 0.159374 Aug 24 15:46:44.554630 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 453/907] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:44 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:45.578742 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:45.579263 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:45.586193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:45.586704 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:45.587144 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:45.587833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:45.588319 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:45.588744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:45.724675 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:45.732975 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:45.734460 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:45.735686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5af10bd0-4f90-4f2c-9b02-5dc42016800c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1744 microversion: 2.20 time: 0.160953 Aug 24 15:46:45.736245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 455/908] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:45 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:46.757698 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:46.758405 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:46.768228 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:46.768936 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:46.769523 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:46.770738 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:46.771071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:46.772103 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:46.915896 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:46.924917 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:46.926518 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:46.928062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f5f79b11-bea3-41e4-bc7d-9b80a863e0db tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.174329 Aug 24 15:46:46.928633 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 454/909] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:46 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:47.951713 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:47.952508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:47.959640 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:47.960434 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:47.960929 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:47.961686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:47.962204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:47.962715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:48.108147 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:48.118954 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:48.120747 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:48.122143 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-2ac23ac4-2a8a-4864-aa25-07067bc4539d tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.174575 Aug 24 15:46:48.138116 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 456/910] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:47 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:48.276212 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-9aa53b08-b857-4de1-ac98-0820be17b06d req-7dfdc055-d97a-484b-b6aa-f5bd64b0da7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fcadfb-256c-4fae-91da-92e0acab0eb4", "name": "network-vif-plugged", "status": "completed", "tag": "971907b7-0cc7-45df-b21d-aeb0f809428b"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:48.287524 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9aa53b08-b857-4de1-ac98-0820be17b06d req-7dfdc055-d97a-484b-b6aa-f5bd64b0da7a service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:48.288296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9aa53b08-b857-4de1-ac98-0820be17b06d req-7dfdc055-d97a-484b-b6aa-f5bd64b0da7a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:48.288902 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-9aa53b08-b857-4de1-ac98-0820be17b06d req-7dfdc055-d97a-484b-b6aa-f5bd64b0da7a service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:48.304562 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-9aa53b08-b857-4de1-ac98-0820be17b06d req-7dfdc055-d97a-484b-b6aa-f5bd64b0da7a service nova] Creating event network-vif-plugged:971907b7-0cc7-45df-b21d-aeb0f809428b for instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 on hv-cinder-84605 Aug 24 15:46:48.309817 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-9aa53b08-b857-4de1-ac98-0820be17b06d req-7dfdc055-d97a-484b-b6aa-f5bd64b0da7a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037432 Aug 24 15:46:48.310622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 455/911] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:46:49.146172 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:49.147091 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:49.154342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:49.155032 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:49.155566 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:49.156505 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:49.156922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:49.157662 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:49.310179 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:49.320105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:49.323747 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:49.324977 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b556af70-a8d0-4373-9826-1ce6263343ee tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.183408 Aug 24 15:46:49.327157 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 457/912] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:49 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:50.351007 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:50.352326 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:50.359354 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:50.360074 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:50.360717 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:50.361590 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:50.362200 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:50.362814 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:50.516448 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:50.526485 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:50.528065 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:50.529252 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a37a298d-583b-4325-88e4-eac6ddd71ae4 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.183906 Aug 24 15:46:50.542894 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 456/913] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:50 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:51.552809 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:51.554296 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:51.561457 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:51.562034 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:51.562539 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:51.563342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:51.564009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:51.564669 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:51.715896 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:51.737200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:51.738717 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:51.740776 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-059378c7-f643-4020-b64c-aa24354927fb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.192057 Aug 24 15:46:51.741665 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 458/914] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:51 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:52.766758 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:52.767485 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:52.778048 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:52.778927 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:52.779725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:52.780532 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:52.781041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:52.782017 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:52.974404 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:52.990694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:52.993344 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:52.994973 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-502000a1-cf5f-4b1e-8763-3e22f14f15f9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.231872 Aug 24 15:46:53.010688 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 457/915] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:52 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:54.018079 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:54.018820 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:54.025963 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:54.026535 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:54.027084 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:54.027865 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:54.028395 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:54.028890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:54.179833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:54.191379 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:54.193504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:54.194700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7d6a42c2-98a2-4d66-96e1-388df8d18919 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.180483 Aug 24 15:46:54.195452 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 459/916] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:54 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:55.217660 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:55.218208 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:55.226119 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:55.226614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:55.227079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:55.227792 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:55.228248 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:55.228675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:55.381844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:55.390740 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:55.392110 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:55.393298 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-af7015d1-42b5-4ed0-9153-e76c810850ff tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1739 microversion: 2.20 time: 0.179808 Aug 24 15:46:55.402922 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 458/917] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:55 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:46:56.419449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:56.420055 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:56.427171 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:56.427810 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:56.428244 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:56.429565 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:56.430022 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:56.430446 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:56.567161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:56.575244 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:56.576744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:56.577912 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5670ea02-fe3f-45f1-bca7-5eb08d622a0a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1721 microversion: 2.20 time: 0.162363 Aug 24 15:46:56.578756 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 460/918] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:56 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:46:57.601749 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:57.602317 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:57.608639 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:57.609126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:57.609552 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:57.610238 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:57.610704 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:57.611124 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:57.741398 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:57.749493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:57.751056 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:57.752214 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d78975b1-902b-438e-bd61-511507735c85 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1721 microversion: 2.20 time: 0.154814 Aug 24 15:46:57.752773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 459/919] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:57 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:58.776094 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:58.776678 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:58.783342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.783821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.784251 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:58.784931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.785380 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.786597 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:58.921523 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:58.929868 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:58.931495 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:58.932658 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-bbc91654-1dc0-44fb-a217-754c10323f00 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1724 microversion: 2.20 time: 0.160614 Aug 24 15:46:58.933222 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 461/920] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:58 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:46:58.956662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dee7fecb-e73a-4098-b759-15ccb51c8e13"}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:58.959618 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:58.965945 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.966427 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.966901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:58.967597 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.968060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.968476 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.248050 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-9ae23b9e-982d-4360-bf5d-2bfc3d877ba1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295357 Aug 24 15:46:59.248675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 460/921] 10.222.0.73 () {62 vars in 1364 bytes} [Wed Aug 24 15:46:58 2022] POST /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:46:59.372106 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:59.372601 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:59.378580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.379104 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.380214 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.381015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.381501 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.381925 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.619328 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-178df50f-80d8-42cd-bde4-f2feddb45c34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-volume_attachments/dee7fecb-e73a-4098-b759-15ccb51c8e13" status: 202 len: 0 microversion: 2.20 time: 0.251214 Aug 24 15:46:59.619912 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 462/922] 10.222.0.73 () {60 vars in 1457 bytes} [Wed Aug 24 15:46:59 2022] DELETE /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-volume_attachments/dee7fecb-e73a-4098-b759-15ccb51c8e13 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:46:59.677687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:46:59.678284 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:59.685037 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.685514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.685944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.686627 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.687221 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.687721 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.718193 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132288) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 15:46:59.786447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3413c8a3-9fdc-4312-a0de-a58bcf1995d8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "POST /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/action" status: 202 len: 0 microversion: 2.20 time: 0.112678 Aug 24 15:46:59.787188 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 461/923] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 15:46:59 2022] POST /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:46:59.795317 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:59.796533 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:59.804972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.805471 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.805911 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.807057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.807713 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.808211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.948444 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:59.958092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:59.959623 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:46:59.960833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-198b8b42-367a-4db0-80d6-7beb1079b948 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1672 microversion: 2.20 time: 0.169440 Aug 24 15:46:59.961548 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 463/924] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:46:59 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:00.274157 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-21f1a84d-5af8-42e0-a5bf-d2774f4a4b33 req-f9dc31da-b8b1-4081-9649-e095c76b5ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fcadfb-256c-4fae-91da-92e0acab0eb4", "name": "network-vif-unplugged", "status": "completed", "tag": "971907b7-0cc7-45df-b21d-aeb0f809428b"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:00.287381 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-21f1a84d-5af8-42e0-a5bf-d2774f4a4b33 req-f9dc31da-b8b1-4081-9649-e095c76b5ffc service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:00.288261 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-21f1a84d-5af8-42e0-a5bf-d2774f4a4b33 req-f9dc31da-b8b1-4081-9649-e095c76b5ffc service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:00.288868 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-21f1a84d-5af8-42e0-a5bf-d2774f4a4b33 req-f9dc31da-b8b1-4081-9649-e095c76b5ffc service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:00.300464 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.compute.server_external_events [req-21f1a84d-5af8-42e0-a5bf-d2774f4a4b33 req-f9dc31da-b8b1-4081-9649-e095c76b5ffc service nova] Unable to find a host for instance c2fcadfb-256c-4fae-91da-92e0acab0eb4. Dropping event network-vif-unplugged {{(pid=132288) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 15:47:00.301769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-21f1a84d-5af8-42e0-a5bf-d2774f4a4b33 req-f9dc31da-b8b1-4081-9649-e095c76b5ffc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031892 Aug 24 15:47:00.302695 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 462/925] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 15:47:00.984591 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:00.985165 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:00.992580 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:00.993064 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:00.993504 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:00.994201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:00.994679 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:00.995110 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:01.125753 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:01.135307 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:01.136797 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:01.137958 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d86fd8ae-4798-4729-9a3a-8c98bcac85da tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.157372 Aug 24 15:47:01.138544 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 464/926] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:00 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:02.160911 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:02.161671 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:02.168100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:02.168576 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:02.169000 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:02.169682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:02.170126 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:02.170542 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:02.317072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:02.327782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:02.329735 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:02.331703 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-c0cc788f-ff3e-4d2f-a7e6-3d40a1daeb46 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.174553 Aug 24 15:47:02.332858 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 463/927] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:02 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:03.357819 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:03.358871 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:03.366552 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:03.367168 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:03.367684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:03.368455 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:03.368999 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:03.369497 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:03.530152 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:03.542088 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:03.543981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:03.545826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-265f24eb-85f0-4c0a-8588-40a81a9804bb tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.191779 Aug 24 15:47:03.555063 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 465/928] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:03 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:04.571417 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:04.572154 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:04.579190 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:04.579608 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:04.580043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:04.580746 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:04.581195 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:04.581616 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:04.598333 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:04.732815 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:04.743556 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:04.745079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:04.746623 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-376f5c7d-e73f-4500-91a2-877a92134a2b tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.180606 Aug 24 15:47:04.762960 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 464/929] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:04 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:05.772015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:05.772658 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:05.780121 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:05.780700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:05.781206 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:05.782036 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:05.782561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:05.783053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:05.788992 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:05.935262 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:05.944207 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:05.945846 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:05.947077 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6076a0a4-bae4-49c5-8a42-3337a6fa9ae1 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.179396 Aug 24 15:47:05.957851 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 466/930] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:05 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:06.972787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:06.974281 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:06.982804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:06.983311 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:06.983752 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:06.984905 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:06.985372 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:06.985800 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:07.127573 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:07.138606 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:07.140146 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:07.141324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-30343ea2-c052-4880-a0b3-063cf4f6564f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.172656 Aug 24 15:47:07.142084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 465/931] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:06 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:08.166262 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:08.166888 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:08.173460 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:08.173940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:08.174376 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:08.175097 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:08.175558 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:08.176630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:08.481587 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:08.491639 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:08.493181 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:08.494362 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-49a6153c-ee5c-4174-a410-39425c1171c2 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.331989 Aug 24 15:47:08.495295 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 467/932] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:08 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:09.519440 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:09.520782 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:09.526871 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:09.533083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:09.533083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:09.533083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:09.533083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:09.533502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:09.533502 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:09.678675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:09.687026 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:09.688517 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:09.689675 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-f38d3ead-12a8-402a-b165-e09cfa5a2576 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.174474 Aug 24 15:47:09.690448 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 466/933] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:09 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:10.712492 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:10.713096 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:10.715309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=32 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:10.720611 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:10.721093 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:10.721558 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:10.722242 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:10.722720 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:10.723270 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:10.854462 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:10.862559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:10.864842 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:10.866000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-179e7b3c-3e5d-4309-8254-36b580fd25e5 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.157408 Aug 24 15:47:10.866550 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 468/934] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:10 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:11.889395 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:11.890034 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:11.897285 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:11.897769 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:11.898203 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:11.898920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:11.899376 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:11.899802 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:12.041342 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:12.049384 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:12.050920 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:12.052111 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-867b4c05-ed16-4af7-ae70-84ad308cddc3 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.166715 Aug 24 15:47:12.052679 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 467/935] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:11 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:13.075546 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:13.076151 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:13.083241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:13.083722 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:13.084153 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:13.084835 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:13.085284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:13.085706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:13.219339 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:13.230463 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:13.232048 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:13.233211 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-274ebf73-de5a-4a83-97de-3ee8d171949f tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.161598 Aug 24 15:47:13.233758 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 469/936] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:13 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:14.256042 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:14.256630 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:14.262979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:14.263447 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:14.263872 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:14.264545 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:14.264996 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:14.265408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:14.426000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-ba85cba4-1ae2-48b8-b39e-13bb915fc6b0 req-ce791640-92d2-44fe-adbd-2857de7915fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fcadfb-256c-4fae-91da-92e0acab0eb4", "name": "network-vif-plugged", "status": "completed", "tag": "971907b7-0cc7-45df-b21d-aeb0f809428b"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:14.436897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ba85cba4-1ae2-48b8-b39e-13bb915fc6b0 req-ce791640-92d2-44fe-adbd-2857de7915fa service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:14.437518 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ba85cba4-1ae2-48b8-b39e-13bb915fc6b0 req-ce791640-92d2-44fe-adbd-2857de7915fa service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:14.438283 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-ba85cba4-1ae2-48b8-b39e-13bb915fc6b0 req-ce791640-92d2-44fe-adbd-2857de7915fa service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:14.451439 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-ba85cba4-1ae2-48b8-b39e-13bb915fc6b0 req-ce791640-92d2-44fe-adbd-2857de7915fa service nova] Creating event network-vif-plugged:971907b7-0cc7-45df-b21d-aeb0f809428b for instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 on hv-cinder-84605 Aug 24 15:47:14.456746 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-ba85cba4-1ae2-48b8-b39e-13bb915fc6b0 req-ce791640-92d2-44fe-adbd-2857de7915fa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034698 Aug 24 15:47:14.457607 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:14.458304 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 470/937] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:47:14.467569 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:14.469434 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:14.470612 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-ac213592-6176-4c17-9718-462ea913dff8 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.218616 Aug 24 15:47:14.471213 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 468/938] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:14 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:15.495825 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:15.496479 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:15.503061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:15.503543 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:15.503977 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:15.504769 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:15.505232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:15.505660 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:15.634357 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:15.642500 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:15.644017 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:15.645567 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b6610309-304e-4a10-81f7-d7e33750ca34 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1730 microversion: 2.20 time: 0.153963 Aug 24 15:47:15.646137 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 471/939] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:15 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:16.669589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:16.670114 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:16.677025 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.677498 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.677928 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.678609 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.679089 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.679511 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.812561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:16.821651 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:16.823167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:16.824324 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-7ddb4cb6-6e2b-42e8-9d40-822e15c10d21 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1717 microversion: 2.20 time: 0.158806 Aug 24 15:47:16.824867 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 469/940] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:16 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:49.782487 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:49.784715 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:49.787724 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=7 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:49.788508 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=30 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:49.794924 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.795410 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.795845 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.796542 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.797000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.797426 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.825590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f24f1311-b07b-4040-b8fd-e85896dfa774 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047162 Aug 24 15:47:49.826137 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 472/941] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 15:47:49 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:49.887870 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:49.888428 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:49.890768 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=7 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:49.891408 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=33 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:49.897891 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.898364 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.898821 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.899508 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:49.900255 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:49.900968 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:49.930106 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:47:50.008684 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3ed235b1-e13c-436a-b7ac-a50d203ad17a tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 204 len: 0 microversion: 2.20 time: 0.124403 Aug 24 15:47:50.009265 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 470/942] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 15:47:49 2022] DELETE /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 15:47:50.019320 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:50.021492 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:50.027752 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:50.028226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:50.028651 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:50.029332 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:50.029776 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:50.030193 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:50.213061 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:50.221121 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:50.222674 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:50.223833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-6a5c52b6-9d9e-4535-847f-f83de482ed4c tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.208454 Aug 24 15:47:50.224374 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 473/943] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:50 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:47:51.247883 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:51.248509 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:51.255834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.256355 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.256793 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.257500 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:51.257957 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:51.258385 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:51.396253 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.404462 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.405939 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:51.407115 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-cfd6c908-085c-4705-b323-946f0b0ef932 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1723 microversion: 2.20 time: 0.163644 Aug 24 15:47:51.407682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 471/944] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:51 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:52.431326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:52.431903 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:52.438731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.438731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.439245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.439875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.440338 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.440759 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.505993 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:52.517405 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:52.518867 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02f332ba23a4a3cacb99f5c69a5b524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9728b1ee454013a3968c27080cd98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:52.520573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-eac50046-45e1-49de-8842-89430afcb37e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 200 len: 1655 microversion: 2.20 time: 0.093212 Aug 24 15:47:52.521350 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 474/945] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:52 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 1655 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:47:52.733287 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-09b3e155-22db-4432-8ddc-46ab908cd290 req-3854fbeb-1fd7-4740-a784-6b5b9ae5a653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fcadfb-256c-4fae-91da-92e0acab0eb4", "name": "network-vif-deleted", "tag": "971907b7-0cc7-45df-b21d-aeb0f809428b"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:52.743637 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-09b3e155-22db-4432-8ddc-46ab908cd290 req-3854fbeb-1fd7-4740-a784-6b5b9ae5a653 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:52.744120 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-09b3e155-22db-4432-8ddc-46ab908cd290 req-3854fbeb-1fd7-4740-a784-6b5b9ae5a653 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:52.744557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-09b3e155-22db-4432-8ddc-46ab908cd290 req-3854fbeb-1fd7-4740-a784-6b5b9ae5a653 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:52.755919 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-09b3e155-22db-4432-8ddc-46ab908cd290 req-3854fbeb-1fd7-4740-a784-6b5b9ae5a653 service nova] Creating event network-vif-deleted:971907b7-0cc7-45df-b21d-aeb0f809428b for instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 on hv-cinder-84605 Aug 24 15:47:52.760661 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-09b3e155-22db-4432-8ddc-46ab908cd290 req-3854fbeb-1fd7-4740-a784-6b5b9ae5a653 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098809 Aug 24 15:47:52.761267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 472/946] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:53.544882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:53.545677 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:53.552998 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:53.553667 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:53.554104 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:53.554911 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:53.555408 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:53.555812 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:53.570185 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] HTTP exception thrown: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Request method failure captured: Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 HTTP/1.1 Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkb5e95KtXgutmtifS8UQCNKy8bY6-CtzgV_2osmqQto6e_BDI3cwtbbjhu6m4vo6dBK6tAMJQ2PKP9VQRn198aiR5f77YV2ePvKFs_gM6TcxH3fdr1yFp7vIliSWhGq7W4B7w5TPc5fp-9ekzRl4Qbg5jtCfwS37VmtENn7ja9W8Rk Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:47:53.571874 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9b9728b1ee454013a3968c27080cd98c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9b9728b1ee454013a3968c27080cd98c"}]}] Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: e02f332ba23a4a3cacb99f5c69a5b524 Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:53.573700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'c2fcadfb-256c-4fae-91da-92e0acab0eb4'} Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:53.578074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:53.579700 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:53.581092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Returning 404 to user: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:53.581092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-07a37107-73b3-4396-aa37-a5fa14b77e98 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 404 len: 111 microversion: 2.20 time: 0.032414 Aug 24 15:47:53.581092 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 475/947] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:53 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:47:53.585131 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-0bbda2d2-2faf-420d-a7df-bf6d5a3df84e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '.version_select at 0x7f07834f1940>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:53.604171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-0bbda2d2-2faf-420d-a7df-bf6d5a3df84e tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717375917" status: 204 len: 0 microversion: 2.20 time: 0.024420 Aug 24 15:47:53.604848 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 473/948] 10.222.0.73 () {60 vars in 1259 bytes} [Wed Aug 24 15:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717375917 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 15:47:55.434942 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:55.435418 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:55.442680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.443169 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.443601 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.444297 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.444747 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.445167 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.459230 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] HTTP exception thrown: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Request method failure captured: Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 HTTP/1.1 Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkb5e95KtXgutmtifS8UQCNKy8bY6-CtzgV_2osmqQto6e_BDI3cwtbbjhu6m4vo6dBK6tAMJQ2PKP9VQRn198aiR5f77YV2ePvKFs_gM6TcxH3fdr1yFp7vIliSWhGq7W4B7w5TPc5fp-9ekzRl4Qbg5jtCfwS37VmtENn7ja9W8Rk Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:47:55.460762 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9b9728b1ee454013a3968c27080cd98c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9b9728b1ee454013a3968c27080cd98c"}]}] Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: e02f332ba23a4a3cacb99f5c69a5b524 Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.462572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'c2fcadfb-256c-4fae-91da-92e0acab0eb4'} Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:55.463680 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.465337 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.466938 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Returning 404 to user: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:55.466938 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3edab676-cceb-45da-9c19-358703692de9 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 404 len: 111 microversion: 2.20 time: 0.031020 Aug 24 15:47:55.466938 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 476/949] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 15:47:55 2022] DELETE /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:47:55.471100 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:55.471827 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: c2fcadfb-256c-4fae-91da-92e0acab0eb4] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:55.481076 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.481554 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.481984 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.482705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:55.483163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:55.483587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:55.496538 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] HTTP exception thrown: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Request method failure captured: Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 HTTP/1.1 Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkb5e95KtXgutmtifS8UQCNKy8bY6-CtzgV_2osmqQto6e_BDI3cwtbbjhu6m4vo6dBK6tAMJQ2PKP9VQRn198aiR5f77YV2ePvKFs_gM6TcxH3fdr1yFp7vIliSWhGq7W4B7w5TPc5fp-9ekzRl4Qbg5jtCfwS37VmtENn7ja9W8Rk Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:47:55.498159 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9b9728b1ee454013a3968c27080cd98c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9b9728b1ee454013a3968c27080cd98c"}]}] Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: e02f332ba23a4a3cacb99f5c69a5b524 Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.499897 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': 'c2fcadfb-256c-4fae-91da-92e0acab0eb4'} Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:55.501011 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. Aug 24 15:47:55.502550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:55.505260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Returning 404 to user: Instance c2fcadfb-256c-4fae-91da-92e0acab0eb4 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:55.505260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-15867faa-b700-4fd0-b2f4-978001a9f0a7 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4" status: 404 len: 111 microversion: 2.20 time: 0.032974 Aug 24 15:47:55.505260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 474/950] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:55 2022] GET /compute/v2.1/servers/c2fcadfb-256c-4fae-91da-92e0acab0eb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:47:56.648383 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:56.648885 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:56.655465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.655938 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.656365 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.657053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.657496 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.657911 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.671628 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] HTTP exception thrown: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Request method failure captured: Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: DELETE /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 HTTP/1.1 Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkb5e95KtXgutmtifS8UQCNKy8bY6-CtzgV_2osmqQto6e_BDI3cwtbbjhu6m4vo6dBK6tAMJQ2PKP9VQRn198aiR5f77YV2ePvKFs_gM6TcxH3fdr1yFp7vIliSWhGq7W4B7w5TPc5fp-9ekzRl4Qbg5jtCfwS37VmtENn7ja9W8Rk Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:47:56.673161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9b9728b1ee454013a3968c27080cd98c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9b9728b1ee454013a3968c27080cd98c"}]}] Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: e02f332ba23a4a3cacb99f5c69a5b524 Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.674955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '6562ed4a-9a9b-454e-a4fd-d0c2e7d19452'} Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:56.675875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.677459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.678981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Returning 404 to user: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:56.678981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5567cc3f-bb7f-4b24-a819-b1f42e07d159 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 404 len: 111 microversion: 2.20 time: 0.030910 Aug 24 15:47:56.678981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 477/951] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 15:47:56 2022] DELETE /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:47:56.683201 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:56.683841 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] [instance: 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:56.690308 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.690824 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.691405 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.692240 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:56.692693 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:56.693115 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:56.706072 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] HTTP exception thrown: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Request method failure captured: Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 HTTP/1.1 Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkb5e95KtXgutmtifS8UQCNKy8bY6-CtzgV_2osmqQto6e_BDI3cwtbbjhu6m4vo6dBK6tAMJQ2PKP9VQRn198aiR5f77YV2ePvKFs_gM6TcxH3fdr1yFp7vIliSWhGq7W4B7w5TPc5fp-9ekzRl4Qbg5jtCfwS37VmtENn7ja9W8Rk Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:47:56.708197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9b9728b1ee454013a3968c27080cd98c", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9b9728b1ee454013a3968c27080cd98c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9b9728b1ee454013a3968c27080cd98c"}]}] Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: 9b9728b1ee454013a3968c27080cd98c Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1323611527 Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: e02f332ba23a4a3cacb99f5c69a5b524 Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1323611527-project Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.709916 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '6562ed4a-9a9b-454e-a4fd-d0c2e7d19452'} Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:56.710884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. Aug 24 15:47:56.712373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:47:56.717979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] Returning 404 to user: Instance 6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:56.717979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-3d260914-ab7f-420e-8c1b-1625f6f99301 tempest-AttachVolumeShelveTestJSON-1323611527 tempest-AttachVolumeShelveTestJSON-1323611527-project] 10.222.0.73 "GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452" status: 404 len: 111 microversion: 2.20 time: 0.030306 Aug 24 15:47:56.717979 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 475/952] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 15:47:56 2022] GET /compute/v2.1/servers/6562ed4a-9a9b-454e-a4fd-d0c2e7d19452 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:48:05.047735 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:05.049875 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:05.056728 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:05.057208 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:05.057636 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:05.058351 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:05.058852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:05.059274 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:05.141245 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f3ae73c7-483c-42dc-bffc-375de5b24988 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "POST /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2/action" status: 200 len: 14 microversion: 2.1 time: 0.097266 Aug 24 15:48:05.141774 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 478/953] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 15:48:05 2022] POST /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:48:06.255775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:06.256551 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:06.260674 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-8e51919b-3ffe-4177-ba7d-e47650f236f7 req-316ed28d-c8b4-4eea-bf8c-eaa51aa4a12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23653e1-bc7c-46f9-b66a-b2744f35f5e2", "tag": "91c5b662-a602-4af7-bcaa-b2673cf2db1a"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:06.262950 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.263529 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.264167 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.265084 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.265538 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.266171 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.272972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-8e51919b-3ffe-4177-ba7d-e47650f236f7 req-316ed28d-c8b4-4eea-bf8c-eaa51aa4a12e service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.273449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-8e51919b-3ffe-4177-ba7d-e47650f236f7 req-316ed28d-c8b4-4eea-bf8c-eaa51aa4a12e service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.274052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-8e51919b-3ffe-4177-ba7d-e47650f236f7 req-316ed28d-c8b4-4eea-bf8c-eaa51aa4a12e service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.288427 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-8e51919b-3ffe-4177-ba7d-e47650f236f7 req-316ed28d-c8b4-4eea-bf8c-eaa51aa4a12e service nova] Creating event network-changed:91c5b662-a602-4af7-bcaa-b2673cf2db1a for instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 on hv-cinder-84605 Aug 24 15:48:06.292413 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:48:06.293582 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-8e51919b-3ffe-4177-ba7d-e47650f236f7 req-316ed28d-c8b4-4eea-bf8c-eaa51aa4a12e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039077 Aug 24 15:48:06.294714 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 479/954] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:06.396911 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d5809962-b68f-4bf1-b029-b7cbfee144d0 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 204 len: 0 microversion: 2.1 time: 0.145025 Aug 24 15:48:06.398267 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 476/955] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:48:06 2022] DELETE /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:48:06.407053 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:06.408070 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:06.417443 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.418273 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.419086 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.420200 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:06.421270 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:06.422387 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:06.560056 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:06.568430 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4386f489-28b5-47ac-8fbc-46e4dbf467aa tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1569 microversion: 2.1 time: 0.165595 Aug 24 15:48:06.569833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 480/956] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:06 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:07.591450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:07.592185 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:07.598772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:07.599259 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:07.599694 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:07.600382 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:07.600838 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:07.601260 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:07.730373 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:07.738596 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-aead5bce-b2d8-43e7-937f-7249cbf09b25 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1569 microversion: 2.1 time: 0.150880 Aug 24 15:48:07.739209 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 477/957] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:07 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:08.759758 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:08.760404 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:08.766899 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:08.767382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:08.767821 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:08.768507 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:08.768963 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:08.770015 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:08.902726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:08.910624 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-1012a6e6-2899-4d86-bb1f-0dbd2edce32c tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1569 microversion: 2.1 time: 0.154786 Aug 24 15:48:08.911210 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 481/958] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:08 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:09.931986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:09.932593 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:09.939076 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:09.939561 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:09.939993 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:09.940678 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:09.941129 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:09.941568 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:10.073725 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:10.081418 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b8347e6f-fc16-49b8-9b6f-1967f63900ee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1569 microversion: 2.1 time: 0.153328 Aug 24 15:48:10.082014 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 478/959] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:09 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:11.103469 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:11.104111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:11.110468 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.110981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.111417 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.112105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:11.112562 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:11.112988 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:11.246598 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:11.254237 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-7867b6b3-edf9-44e4-b0b3-3896b5c22fec tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1569 microversion: 2.1 time: 0.154998 Aug 24 15:48:11.255402 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 482/960] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:11 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:12.277218 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:12.277944 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:12.284563 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:12.285079 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:12.285519 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:12.286219 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:12.286707 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:12.287139 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:12.416713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:12.424551 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-506c3a36-50d2-47e2-9f28-7f568b0373db tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1569 microversion: 2.1 time: 0.151166 Aug 24 15:48:12.425128 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 479/961] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:12 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:13.445684 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:13.446401 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:13.453054 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:13.453547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:13.453980 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:13.454706 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:13.455233 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:13.455662 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:13.597798 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:13.605995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-34134546-950d-4b20-8d25-70f8d189147f tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1569 microversion: 2.1 time: 0.164338 Aug 24 15:48:13.616738 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 483/962] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:13 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:14.092332 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [req-1fdebe87-4fbc-45c9-831e-86946e251796 req-dd4a5abb-b763-45e0-9a40-da860e164374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23653e1-bc7c-46f9-b66a-b2744f35f5e2", "name": "network-vif-deleted", "tag": "91c5b662-a602-4af7-bcaa-b2673cf2db1a"}]} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:14.103879 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-1fdebe87-4fbc-45c9-831e-86946e251796 req-dd4a5abb-b763-45e0-9a40-da860e164374 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.104766 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-1fdebe87-4fbc-45c9-831e-86946e251796 req-dd4a5abb-b763-45e0-9a40-da860e164374 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.105301 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [req-1fdebe87-4fbc-45c9-831e-86946e251796 req-dd4a5abb-b763-45e0-9a40-da860e164374 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.118548 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.compute.server_external_events [req-1fdebe87-4fbc-45c9-831e-86946e251796 req-dd4a5abb-b763-45e0-9a40-da860e164374 service nova] Creating event network-vif-deleted:91c5b662-a602-4af7-bcaa-b2673cf2db1a for instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 on hv-cinder-84605 Aug 24 15:48:14.125311 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [req-1fdebe87-4fbc-45c9-831e-86946e251796 req-dd4a5abb-b763-45e0-9a40-da860e164374 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036819 Aug 24 15:48:14.126233 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 480/963] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:14.627622 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:14.628240 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:14.634814 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.635298 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.635731 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.636420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:14.636877 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:14.637321 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:14.702074 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:14.710446 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-48f4d705-e4a8-4081-8cf8-bbb547e825c9 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1219 microversion: 2.1 time: 0.086829 Aug 24 15:48:14.711032 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 484/964] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:14 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:15.732887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:15.733514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:15.739686 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:15.740163 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:15.741233 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:15.741917 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:15.742370 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:15.742818 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:15.808507 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:15.816250 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4fc59e00-4e29-451a-86ab-d47311cfe922 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1219 microversion: 2.1 time: 0.088140 Aug 24 15:48:15.816816 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 481/965] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:15 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:16.840357 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:16.840962 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:16.850459 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.851000 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.851449 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.852852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.853315 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.853808 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.885744 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:16.886227 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:16.886686 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:16.887248 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.objects.instance [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lazy-loading 'fault' on Instance uuid e23653e1-bc7c-46f9-b66a-b2744f35f5e2 {{(pid=132289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:48:16.931922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90be4ab702e14f4387b0883dead72d9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3760b78ba8584e6c81c46d48113fcd45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:16.940009 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5a7a8854-5c8c-4cf3-a264-18bfff879b6b tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 200 len: 1224 microversion: 2.1 time: 0.103762 Aug 24 15:48:16.940570 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 485/966] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:16 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:17.287589 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1877379085", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-292842636", "security_groups": [{"name": "tempest-secgroup-smoke-514253164"}], "block_device_mapping_v2": [{"uuid": "be35e592-2122-4ecb-8cef-82b86dab7226", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55e08d2e-d6cb-4529-86e4-566ae8e28cc6"}]}} {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:17.402887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.network.neutron [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] validate_networks() for [('55e08d2e-d6cb-4529-86e4-566ae8e28cc6', None, None, None, None, None)] {{(pid=132288) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:48:17.837363 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Flavor limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:48:17.837901 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Image limits 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:48:17.838446 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Flavor pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:48:17.838969 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Image pref 0:0:0 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:48:17.839446 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.virt.hardware [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:48:17.848350 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.848824 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.849310 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.850107 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.850631 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.851092 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.869775 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for project b496441965834f65a8d0813e8221c685. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:48:17.874581 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.quota [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Getting quotas for user 81be4c83d3b04624ae11bcbf37a44309 and project b496441965834f65a8d0813e8221c685. Resources: {'instances', 'ram', 'cores'} {{(pid=132288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:48:17.935410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Going to run 1 instances... {{(pid=132288) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:48:17.937614 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be35e592-2122-4ecb-8cef-82b86dab7226',volume_size=None,volume_type=None)] {{(pid=132288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:48:17.961470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:17.962090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] [instance: e23653e1-bc7c-46f9-b66a-b2744f35f5e2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:17.970823 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.971382 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.971897 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.972697 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:17.973163 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:17.973653 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:17.988702 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] HTTP exception thrown: Instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 could not be found. Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Request method failure captured: Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 HTTP/1.1 Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkch8lHtlXwFhpP16ZAsHj0Ku9gwrSPQB5LI14nt1xj-cnVBMF07QEid2E1AL0y-vA_pBG7nQJFHIJOm3V5jPDjiPUKdEN0xprKXsrxQRmpkpKU0sNNYCJnN_wLYvq6ojyT64bLIMEIbyDqLQ42upwr-xKd8W6dlK8qHgdl0P9Ii064 Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: 3760b78ba8584e6c81c46d48113fcd45 Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-TestShelveInstance-2056454475 Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:48:17.992226 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3760b78ba8584e6c81c46d48113fcd45", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3760b78ba8584e6c81c46d48113fcd45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3760b78ba8584e6c81c46d48113fcd45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3760b78ba8584e6c81c46d48113fcd45"}]}] Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-TestShelveInstance-2056454475 Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: 3760b78ba8584e6c81c46d48113fcd45 Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-TestShelveInstance-2056454475 Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-TestShelveInstance-2056454475-project Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 90be4ab702e14f4387b0883dead72d9f Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-TestShelveInstance-2056454475-project Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 could not be found. Aug 24 15:48:17.993830 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': 'e23653e1-bc7c-46f9-b66a-b2744f35f5e2'} Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 could not be found. Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:17.994803 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 could not be found. Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 could not be found. Aug 24 15:48:17.996217 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:48:17.997436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Returning 404 to user: Instance e23653e1-bc7c-46f9-b66a-b2744f35f5e2 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:17.997436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-c3d0e0ec-91c8-45dd-b142-4b078cfb4cee tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2" status: 404 len: 111 microversion: 2.1 time: 0.036260 Aug 24 15:48:17.997436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 486/967] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:17 2022] GET /compute/v2.1/servers/e23653e1-bc7c-46f9-b66a-b2744f35f5e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:18.096831 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-312e44fc-8fe9-464a-a7ed-be32488ce291 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.813878 Aug 24 15:48:18.097480 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 482/968] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 15:48:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:48:18.110255 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-b61ecea9-fa40-44a1-a82a-c1c16b45aac0 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:18.112078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-b61ecea9-fa40-44a1-a82a-c1c16b45aac0 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:18.186787 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-b61ecea9-fa40-44a1-a82a-c1c16b45aac0 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:18.190488 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-d228c25d-9bdb-46dd-8872-3b84ee8700a8 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] Calling method '.version_select at 0x7f07837c7820>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:18.194313 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-b61ecea9-fa40-44a1-a82a-c1c16b45aac0 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1094 microversion: 2.1 time: 0.088760 Aug 24 15:48:18.217577 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 487/969] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:18 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:18.222529 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-d228c25d-9bdb-46dd-8872-3b84ee8700a8 tempest-TestShelveInstance-2056454475 tempest-TestShelveInstance-2056454475-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1038709999" status: 202 len: 0 microversion: 2.1 time: 0.042783 Aug 24 15:48:18.223142 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 483/970] 10.222.0.73 () {58 vars in 1254 bytes} [Wed Aug 24 15:48:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1038709999 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:48:19.218944 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:19.220553 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:19.231161 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.232045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.232765 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.233757 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:19.235520 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:19.235985 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:19.314376 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:19.323302 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-93f7c946-6bc2-4f5f-a5a7-6ebfa0b8b245 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1192 microversion: 2.1 time: 0.108923 Aug 24 15:48:19.330670 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 488/971] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:19 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:20.353905 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:20.354543 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:20.359411 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:20.370199 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.370722 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.371358 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.372493 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:20.378000 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:20.378629 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:20.392975 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:20.504256 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:20.515504 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-610e2e0d-f5e6-408e-9182-82fcdae49456 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1198 microversion: 2.1 time: 0.164612 Aug 24 15:48:20.518172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 484/972] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:20 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1198 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:21.395007 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-fc94e880-c8e5-49e7-930f-c6c97d9e09f9 req-b62dc584-ee82-4b32-b914-581512fd5f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d91f99-39cd-41fe-97cf-d48c53761992", "tag": "a3d66c91-ae1b-435e-9fca-68a3001fef3d"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:21.401724 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=39 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:21.408326 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fc94e880-c8e5-49e7-930f-c6c97d9e09f9 req-b62dc584-ee82-4b32-b914-581512fd5f5f service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:21.408804 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fc94e880-c8e5-49e7-930f-c6c97d9e09f9 req-b62dc584-ee82-4b32-b914-581512fd5f5f service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:21.409243 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-fc94e880-c8e5-49e7-930f-c6c97d9e09f9 req-b62dc584-ee82-4b32-b914-581512fd5f5f service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:21.414057 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=77 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:21.421981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-fc94e880-c8e5-49e7-930f-c6c97d9e09f9 req-b62dc584-ee82-4b32-b914-581512fd5f5f service nova] Creating event network-changed:a3d66c91-ae1b-435e-9fca-68a3001fef3d for instance 17d91f99-39cd-41fe-97cf-d48c53761992 on hv-cinder-84605 Aug 24 15:48:21.427922 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-fc94e880-c8e5-49e7-930f-c6c97d9e09f9 req-b62dc584-ee82-4b32-b914-581512fd5f5f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036352 Aug 24 15:48:21.430325 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 489/973] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:21.542044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:21.542752 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:21.549699 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:21.550216 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:21.550739 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:21.551438 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:21.551884 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:21.552296 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:21.723737 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:21.734858 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-de95e647-1a4b-4877-bb72-eaa47f9edc5d tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.197766 Aug 24 15:48:21.739581 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 485/974] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:21 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:22.761412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:22.762436 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:22.768995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:22.769571 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:22.770078 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:22.770905 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:22.771442 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:22.772734 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:23.016336 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:23.025004 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-14ccd1ae-1534-4fc0-b147-e83271760dc8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.268472 Aug 24 15:48:23.025561 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 490/975] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:22 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:24.045227 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:24.045806 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:24.056263 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.057039 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.057384 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:24.058060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.058514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.059010 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:24.233839 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:24.241996 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-80c65dda-c066-442e-9a3f-62e31ba8def1 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.200723 Aug 24 15:48:24.243309 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 486/976] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:24 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:25.262531 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:25.263516 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:25.270495 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:25.271108 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:25.271667 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:25.272635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:25.273176 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:25.273668 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:25.426077 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:25.436361 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-5e566215-16ef-4144-b249-878246d4cb3f tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.177784 Aug 24 15:48:25.436972 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 491/977] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:25 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:26.456580 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:26.457194 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:26.463339 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:26.463825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:26.464262 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:26.464955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:26.465410 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:26.465836 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:26.600514 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:26.608983 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-549e4234-4ffb-4598-844e-56498b3e1802 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.156241 Aug 24 15:48:26.609556 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 487/978] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:26 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:27.630572 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:27.631190 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:27.637517 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:27.637995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:27.638425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:27.639146 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:27.639602 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:27.640025 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:27.770308 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:27.777894 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a01d4446-f268-44c6-92a6-9b3026ceac10 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.151321 Aug 24 15:48:27.778476 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 492/979] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:27 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:28.799386 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:28.800000 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:28.802331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=2 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:28.803547 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell0:SELECT=6 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:28.809429 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:28.809915 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:28.810353 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:28.811078 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:28.811532 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:28.811955 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:28.955402 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:28.963422 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-717b2a35-884b-4c3f-838a-1a0ed8dd7de9 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.167933 Aug 24 15:48:28.963986 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 488/980] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:28 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:29.984569 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:29.985093 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:29.987133 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell0:SELECT=2 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:29.992783 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:29.993260 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:29.993694 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:29.994368 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:29.994850 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:29.995271 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:30.123421 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:30.131807 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-ca0f86ca-c3c3-492a-8b18-11186534789a tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.150537 Aug 24 15:48:30.132420 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 493/981] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:29 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:31.152947 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:31.153550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:31.159867 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:31.160337 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:31.160812 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:31.161433 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:31.161877 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:31.162948 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:31.294196 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:31.301833 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-24c6e54b-7ed6-4fb5-aec0-17c539b8d428 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.152701 Aug 24 15:48:31.302399 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 489/982] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:31 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:32.321625 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:32.322229 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:32.328639 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.329116 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.329542 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.330248 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.330710 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.331129 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.460461 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:32.468209 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f00eb7d7-5fba-4f80-a2ec-1fce24ebd68e tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.150596 Aug 24 15:48:32.468769 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 494/983] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:32 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:33.489415 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:33.490028 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:33.497253 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:33.497733 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:33.498165 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:33.498887 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:33.499337 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:33.499759 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:33.629703 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:33.637469 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-82397af9-c079-4eaa-9778-416d750a1b02 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.152060 Aug 24 15:48:33.638028 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 490/984] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:33 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:34.657422 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:34.657940 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:34.664461 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.664923 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.665352 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.666028 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.666474 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.666915 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.799883 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:34.808072 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-4fdd65ba-12e7-469c-8ae3-9410c6bcec63 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.154626 Aug 24 15:48:34.808631 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 495/985] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:34 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:35.829349 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:35.829977 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:35.836600 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.837075 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.837507 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.838198 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.838662 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.839101 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.973601 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:35.982201 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-44e540a0-932f-41f2-a31f-23a6be77b5be tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.156794 Aug 24 15:48:35.982807 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 491/986] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:35 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:36.444596 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-dde0121f-0fec-4895-913a-fdd330729e76 req-94cea097-4aeb-4a21-8924-8b9ced51f4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d91f99-39cd-41fe-97cf-d48c53761992", "name": "network-vif-plugged", "status": "completed", "tag": "a3d66c91-ae1b-435e-9fca-68a3001fef3d"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:36.454547 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-dde0121f-0fec-4895-913a-fdd330729e76 req-94cea097-4aeb-4a21-8924-8b9ced51f4f5 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:36.455052 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-dde0121f-0fec-4895-913a-fdd330729e76 req-94cea097-4aeb-4a21-8924-8b9ced51f4f5 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:36.455483 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-dde0121f-0fec-4895-913a-fdd330729e76 req-94cea097-4aeb-4a21-8924-8b9ced51f4f5 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:36.468792 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-dde0121f-0fec-4895-913a-fdd330729e76 req-94cea097-4aeb-4a21-8924-8b9ced51f4f5 service nova] Creating event network-vif-plugged:a3d66c91-ae1b-435e-9fca-68a3001fef3d for instance 17d91f99-39cd-41fe-97cf-d48c53761992 on hv-cinder-84605 Aug 24 15:48:36.473932 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-dde0121f-0fec-4895-913a-fdd330729e76 req-94cea097-4aeb-4a21-8924-8b9ced51f4f5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216370 Aug 24 15:48:36.474509 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 496/987] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:37.003773 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:37.004450 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:37.012557 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.013049 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.013487 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.014485 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.014966 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.015396 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.160071 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:37.168522 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-60a96b3c-831b-4df0-8c86-d4c7b210c84b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1265 microversion: 2.1 time: 0.168788 Aug 24 15:48:37.169093 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 492/988] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:36 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:38.193309 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:38.194387 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:38.208525 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.209380 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.209983 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.210882 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.211630 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.212174 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.355008 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:38.362787 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-0ff665eb-758d-4599-a662-c51458e8d5b8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1453 microversion: 2.1 time: 0.175492 Aug 24 15:48:38.363440 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 497/989] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:38 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:38.383372 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:38.383905 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:38.390803 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.391464 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.392147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.393142 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:38.393670 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:38.394172 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:38.557467 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:38.565282 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-65d65cba-404d-445a-b7e4-b74fefc2689b tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1453 microversion: 2.1 time: 0.185978 Aug 24 15:48:38.565853 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 493/990] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:38 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:40.222934 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-98c8ffd3-f396-46ed-9de5-4d7c0760e522 req-ffdbe6bc-ee11-4c26-8981-ab4d1b0ffd38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d91f99-39cd-41fe-97cf-d48c53761992", "tag": "a3d66c91-ae1b-435e-9fca-68a3001fef3d"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:40.233201 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-98c8ffd3-f396-46ed-9de5-4d7c0760e522 req-ffdbe6bc-ee11-4c26-8981-ab4d1b0ffd38 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.233736 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-98c8ffd3-f396-46ed-9de5-4d7c0760e522 req-ffdbe6bc-ee11-4c26-8981-ab4d1b0ffd38 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.234174 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-98c8ffd3-f396-46ed-9de5-4d7c0760e522 req-ffdbe6bc-ee11-4c26-8981-ab4d1b0ffd38 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.246342 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-98c8ffd3-f396-46ed-9de5-4d7c0760e522 req-ffdbe6bc-ee11-4c26-8981-ab4d1b0ffd38 service nova] Creating event network-changed:a3d66c91-ae1b-435e-9fca-68a3001fef3d for instance 17d91f99-39cd-41fe-97cf-d48c53761992 on hv-cinder-84605 Aug 24 15:48:40.251450 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-98c8ffd3-f396-46ed-9de5-4d7c0760e522 req-ffdbe6bc-ee11-4c26-8981-ab4d1b0ffd38 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092277 Aug 24 15:48:40.252045 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 498/991] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:08.353217 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b45a1508-478c-46da-a09b-d64487273026] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 15:50:08.354787 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_api:SELECT=19 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:08.356043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG dbcounter [-] [132288] Writing DB stats nova_cell1:SELECT=59 {{(pid=132288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:08.357156 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_api:SELECT=19 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:08.358166 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG dbcounter [-] [132289] Writing DB stats nova_cell1:SELECT=47 {{(pid=132289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:08.360783 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:08.361348 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:08.363105 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-1075024e-09e1-4771-b3db-b2114a659fbd req-a8b22d8a-c034-4ffd-9aaa-3ad05097fdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d91f99-39cd-41fe-97cf-d48c53761992", "tag": "a3d66c91-ae1b-435e-9fca-68a3001fef3d"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:08.368411 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.368900 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.369331 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.370109 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.370550 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.373059 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.373756 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-1075024e-09e1-4771-b3db-b2114a659fbd req-a8b22d8a-c034-4ffd-9aaa-3ad05097fdaa service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.374366 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-1075024e-09e1-4771-b3db-b2114a659fbd req-a8b22d8a-c034-4ffd-9aaa-3ad05097fdaa service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.374834 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-1075024e-09e1-4771-b3db-b2114a659fbd req-a8b22d8a-c034-4ffd-9aaa-3ad05097fdaa service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.388148 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-1075024e-09e1-4771-b3db-b2114a659fbd req-a8b22d8a-c034-4ffd-9aaa-3ad05097fdaa service nova] Creating event network-changed:a3d66c91-ae1b-435e-9fca-68a3001fef3d for instance 17d91f99-39cd-41fe-97cf-d48c53761992 on hv-cinder-84605 Aug 24 15:50:08.393197 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-1075024e-09e1-4771-b3db-b2114a659fbd req-a8b22d8a-c034-4ffd-9aaa-3ad05097fdaa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039495 Aug 24 15:50:08.393987 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 499/992] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:08.404834 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:50:08.489470 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4a1c0294-14c7-4f02-beb7-d0acf2f62513 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "DELETE /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 204 len: 0 microversion: 2.1 time: 0.137687 Aug 24 15:50:08.493393 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 494/993] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:50:08 2022] DELETE /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:50:08.499261 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:08.499966 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:08.506232 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.506995 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.507421 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.508118 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.508559 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.508981 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.653656 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:08.661465 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-f009a97a-79c1-4503-9f4f-06c74387bdac tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1577 microversion: 2.1 time: 0.166610 Aug 24 15:50:08.662109 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 500/994] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:08 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:09.684367 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:09.684976 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:09.692041 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.692515 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.692941 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.693621 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.694065 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.694481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.713022 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO oslo.messaging._drivers.impl_rabbit [-] [b45a1508-478c-46da-a09b-d64487273026] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49268. Aug 24 15:50:09.835352 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:09.843666 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-b3553080-6d97-4080-ba91-55c1c4a5f5ed tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1577 microversion: 2.1 time: 0.164664 Aug 24 15:50:09.844234 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 495/995] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:09 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:10.779043 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-9314a6ab-d2c3-4f4e-81a6-9ee4dff46581 req-0eee860c-0cad-4586-a999-3f319cc9989c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d91f99-39cd-41fe-97cf-d48c53761992", "name": "network-vif-deleted", "tag": "a3d66c91-ae1b-435e-9fca-68a3001fef3d"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:10.788730 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-9314a6ab-d2c3-4f4e-81a6-9ee4dff46581 req-0eee860c-0cad-4586-a999-3f319cc9989c service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.789204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-9314a6ab-d2c3-4f4e-81a6-9ee4dff46581 req-0eee860c-0cad-4586-a999-3f319cc9989c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.789625 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-9314a6ab-d2c3-4f4e-81a6-9ee4dff46581 req-0eee860c-0cad-4586-a999-3f319cc9989c service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.800864 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-9314a6ab-d2c3-4f4e-81a6-9ee4dff46581 req-0eee860c-0cad-4586-a999-3f319cc9989c service nova] Creating event network-vif-deleted:a3d66c91-ae1b-435e-9fca-68a3001fef3d for instance 17d91f99-39cd-41fe-97cf-d48c53761992 on hv-cinder-84605 Aug 24 15:50:10.806204 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-9314a6ab-d2c3-4f4e-81a6-9ee4dff46581 req-0eee860c-0cad-4586-a999-3f319cc9989c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Aug 24 15:50:10.806834 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 501/996] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:10.867197 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:10.867713 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:10.875219 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.875709 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.876147 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.876847 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:10.877307 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:10.877735 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.944452 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:10.952247 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-69dd799d-c95d-43de-b027-fd9873860b65 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 200 len: 1225 microversion: 2.1 time: 0.088756 Aug 24 15:50:10.952816 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 496/997] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:10 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:11.974412 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:11.975123 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 17d91f99-39cd-41fe-97cf-d48c53761992] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:11.982536 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.983041 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.983470 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.984145 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:11.984590 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:11.985285 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:11.998494 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] HTTP exception thrown: Instance 17d91f99-39cd-41fe-97cf-d48c53761992 could not be found. Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Request method failure captured: Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 HTTP/1.1 Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkcKYPuYAlY_9hdX7fdS8MdabQt7eYRPCmUBHTtip-4eoPHfH7QKVyccAJfrJg4RPghpk9yBze894W52Cu0s4Qd7M5kMKXu188J3Z-xN_KHErov0AKsaZX0zI63-licsc2ZyCetPBS40qYa1oqTu_jPuzHgW9WXXCSJbI6Nr87OMdAY Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:50:12.000101 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b496441965834f65a8d0813e8221c685", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b496441965834f65a8d0813e8221c685"}]}] Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 81be4c83d3b04624ae11bcbf37a44309 Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 17d91f99-39cd-41fe-97cf-d48c53761992 could not be found. Aug 24 15:50:12.001826 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '17d91f99-39cd-41fe-97cf-d48c53761992'} Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d91f99-39cd-41fe-97cf-d48c53761992 could not be found. Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:12.003027 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d91f99-39cd-41fe-97cf-d48c53761992 could not be found. Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d91f99-39cd-41fe-97cf-d48c53761992 could not be found. Aug 24 15:50:12.004648 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:12.006090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Returning 404 to user: Instance 17d91f99-39cd-41fe-97cf-d48c53761992 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:12.006090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-3337ed13-d1d2-40ff-ba5a-f99d8f75c037 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992" status: 404 len: 111 microversion: 2.1 time: 0.031236 Aug 24 15:50:12.006090 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 502/998] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:11 2022] GET /compute/v2.1/servers/17d91f99-39cd-41fe-97cf-d48c53761992 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:15.057175 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:15.058357 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:15.059238 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-0aa334be-3e9f-4146-ab0e-637ca2bbb0bc req-f502c794-0c65-47fc-af35-5365430c1f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877b318e-d10f-47a2-b221-5b5d23400aa9", "tag": "c494b458-5e21-4458-a860-36829d3f0f6b"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:15.067670 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.068416 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.069069 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.069370 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-0aa334be-3e9f-4146-ab0e-637ca2bbb0bc req-f502c794-0c65-47fc-af35-5365430c1f78 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.069931 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-0aa334be-3e9f-4146-ab0e-637ca2bbb0bc req-f502c794-0c65-47fc-af35-5365430c1f78 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.070423 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-0aa334be-3e9f-4146-ab0e-637ca2bbb0bc req-f502c794-0c65-47fc-af35-5365430c1f78 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.070781 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.071432 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.072055 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.084131 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-0aa334be-3e9f-4146-ab0e-637ca2bbb0bc req-f502c794-0c65-47fc-af35-5365430c1f78 service nova] Creating event network-changed:c494b458-5e21-4458-a860-36829d3f0f6b for instance 877b318e-d10f-47a2-b221-5b5d23400aa9 on hv-cinder-84605 Aug 24 15:50:15.089332 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-0aa334be-3e9f-4146-ab0e-637ca2bbb0bc req-f502c794-0c65-47fc-af35-5365430c1f78 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034390 Aug 24 15:50:15.090112 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 503/999] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:50:15.101587 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Going to try to terminate instance {{(pid=132288) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:50:15.190344 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-4903a74f-dcd5-444a-8f85-652a80d6e275 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "DELETE /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 204 len: 0 microversion: 2.1 time: 0.137599 Aug 24 15:50:15.191481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 497/1000] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:50:15 2022] DELETE /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:50:15.201407 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:15.202400 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:15.208726 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.209218 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.209652 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.210381 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:15.211001 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:15.211432 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:15.363979 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.policy [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132289) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:15.372460 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-d2cee48d-4e3b-4269-a86c-76400b6781e4 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1576 microversion: 2.1 time: 0.176476 Aug 24 15:50:15.373032 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 504/1001] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:15 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:16.394087 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:16.394808 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:16.401145 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.401618 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.402044 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.403606 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:16.404083 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:16.404507 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:16.538407 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:16.546840 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-a588259a-ec18-4aed-b062-0cdcf7be99bf tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1576 microversion: 2.1 time: 0.156976 Aug 24 15:50:16.547406 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 498/1002] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:16 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:17.555448 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [req-9ce9a795-eccf-453c-b340-5ec56088ffe8 req-c4ab87dc-6e0d-416e-af36-a731cb6f02e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877b318e-d10f-47a2-b221-5b5d23400aa9", "name": "network-vif-deleted", "tag": "c494b458-5e21-4458-a860-36829d3f0f6b"}]} {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:17.567425 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-9ce9a795-eccf-453c-b340-5ec56088ffe8 req-c4ab87dc-6e0d-416e-af36-a731cb6f02e8 service nova] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.568001 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-9ce9a795-eccf-453c-b340-5ec56088ffe8 req-c4ab87dc-6e0d-416e-af36-a731cb6f02e8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.568499 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [req-9ce9a795-eccf-453c-b340-5ec56088ffe8 req-c4ab87dc-6e0d-416e-af36-a731cb6f02e8 service nova] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.568665 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:17.569804 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:17.575789 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.576499 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.576971 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.577844 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.578481 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.579095 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.582414 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.compute.server_external_events [req-9ce9a795-eccf-453c-b340-5ec56088ffe8 req-c4ab87dc-6e0d-416e-af36-a731cb6f02e8 service nova] Creating event network-vif-deleted:c494b458-5e21-4458-a860-36829d3f0f6b for instance 877b318e-d10f-47a2-b221-5b5d23400aa9 on hv-cinder-84605 Aug 24 15:50:17.588873 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [req-9ce9a795-eccf-453c-b340-5ec56088ffe8 req-c4ab87dc-6e0d-416e-af36-a731cb6f02e8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037072 Aug 24 15:50:17.589472 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 505/1003] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 15:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:50:17.644183 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.policy [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81be4c83d3b04624ae11bcbf37a44309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b496441965834f65a8d0813e8221c685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:17.652060 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-54c4d3aa-d027-4965-8c45-9943a52175f8 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 200 len: 1225 microversion: 2.1 time: 0.087669 Aug 24 15:50:17.652682 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 499/1004] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:17 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:50:18.673427 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:18.674132 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 877b318e-d10f-47a2-b221-5b5d23400aa9] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:18.680943 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.681424 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.681860 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.682570 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.683037 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.683461 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.700527 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] HTTP exception thrown: Instance 877b318e-d10f-47a2-b221-5b5d23400aa9 could not be found. Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Request method failure captured: Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 HTTP/1.1 Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkcKYPuYAlY_9hdX7fdS8MdabQt7eYRPCmUBHTtip-4eoPHfH7QKVyccAJfrJg4RPghpk9yBze894W52Cu0s4Qd7M5kMKXu188J3Z-xN_KHErov0AKsaZX0zI63-licsc2ZyCetPBS40qYa1oqTu_jPuzHgW9WXXCSJbI6Nr87OMdAY Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:50:18.702160 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b496441965834f65a8d0813e8221c685", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b496441965834f65a8d0813e8221c685"}]}] Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 81be4c83d3b04624ae11bcbf37a44309 Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 877b318e-d10f-47a2-b221-5b5d23400aa9 could not be found. Aug 24 15:50:18.703986 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '877b318e-d10f-47a2-b221-5b5d23400aa9'} Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877b318e-d10f-47a2-b221-5b5d23400aa9 could not be found. Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:18.705801 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877b318e-d10f-47a2-b221-5b5d23400aa9 could not be found. Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877b318e-d10f-47a2-b221-5b5d23400aa9 could not be found. Aug 24 15:50:18.707609 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:18.709111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Returning 404 to user: Instance 877b318e-d10f-47a2-b221-5b5d23400aa9 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:18.709111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-8b91e14b-c968-4f89-ad60-aef83c33321c tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9" status: 404 len: 111 microversion: 2.1 time: 0.035004 Aug 24 15:50:18.709111 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 506/1005] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:18 2022] GET /compute/v2.1/servers/877b318e-d10f-47a2-b221-5b5d23400aa9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:19.143233 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:19.143772 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.compute.api [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132288) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:19.150293 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.150898 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.151336 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.152063 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.153090 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.153705 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG oslo_concurrency.lockutils [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.167454 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.wsgi [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] HTTP exception thrown: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Request method failure captured: Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: request: DELETE /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 HTTP/1.1 Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept: application/json Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Accept-Encoding: identity Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Connection: close Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Length: 0 Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Content-Type: application/json Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Host: 10.222.0.73 Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Openstack-System-Scope: None Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Auth-Token: gAAAAABjBkcKYPuYAlY_9hdX7fdS8MdabQt7eYRPCmUBHTtip-4eoPHfH7QKVyccAJfrJg4RPghpk9yBze894W52Cu0s4Qd7M5kMKXu188J3Z-xN_KHErov0AKsaZX0zI63-licsc2ZyCetPBS40qYa1oqTu_jPuzHgW9WXXCSJbI6Nr87OMdAY Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Id: None Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Domain-Name: None Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Identity-Status: Confirmed Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Is-Admin-Project: True Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Id: default Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Domain-Name: Default Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Project-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Role: reader,member Aug 24 15:50:19.169305 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Roles: reader,member Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b496441965834f65a8d0813e8221c685", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b496441965834f65a8d0813e8221c685"}]}] Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Id: default Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Domain-Name: Default Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Id: 81be4c83d3b04624ae11bcbf37a44309 Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: X-User-Name: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: method: > Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: exception: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.171043 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: action_args: {'id': '2939b24d-ed1a-4b5f-85c7-ba39b537afd2'} Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:19.172013 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.173622 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.175431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Returning 404 to user: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. {{(pid=132288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:19.175431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-e6eb394f-3ef7-487e-a248-1191d4f633d3 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 404 len: 111 microversion: 2.1 time: 0.031404 Aug 24 15:50:19.175431 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 500/1006] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 15:50:19 2022] DELETE /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:19.180241 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '>' {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:19.180852 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.compute.api [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] [instance: 2939b24d-ed1a-4b5f-85c7-ba39b537afd2] Fetching instance by UUID {{(pid=132289) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:19.186892 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.187385 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.187807 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.188488 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Acquiring lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.188937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.189364 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG oslo_concurrency.lockutils [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Lock "2d7efa9e-3929-4bb8-bb7f-bcfc584eee15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.204793 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.wsgi [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] HTTP exception thrown: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Request method failure captured: Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: request: GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 HTTP/1.1 Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept: application/json Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Accept-Encoding: identity Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Connection: close Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Length: 0 Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Content-Type: application/json Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Host: 10.222.0.73 Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Openstack-System-Scope: None Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Auth-Token: gAAAAABjBkcKYPuYAlY_9hdX7fdS8MdabQt7eYRPCmUBHTtip-4eoPHfH7QKVyccAJfrJg4RPghpk9yBze894W52Cu0s4Qd7M5kMKXu188J3Z-xN_KHErov0AKsaZX0zI63-licsc2ZyCetPBS40qYa1oqTu_jPuzHgW9WXXCSJbI6Nr87OMdAY Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Id: None Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Domain-Name: None Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Identity-Status: Confirmed Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Is-Admin-Project: True Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Id: default Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Domain-Name: Default Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Project-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Role: reader,member Aug 24 15:50:19.206284 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Roles: reader,member Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b496441965834f65a8d0813e8221c685", "adminURL": "http://10.222.0.73:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b496441965834f65a8d0813e8221c685"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b496441965834f65a8d0813e8221c685"}]}] Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Id: b496441965834f65a8d0813e8221c685 Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802697822 Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Id: default Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Domain-Name: Default Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Id: 81be4c83d3b04624ae11bcbf37a44309 Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: X-User-Name: tempest-TestVolumeBootPattern-1802697822-project Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: method: > Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: exception: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.208042 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: action_args: {'id': '2939b24d-ed1a-4b5f-85c7-ba39b537afd2'} Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: {{(pid=132289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:19.212068 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. Aug 24 15:50:19.213606 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: ERROR nova.api.openstack.wsgi Aug 24 15:50:19.215955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: DEBUG nova.api.openstack.wsgi [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Returning 404 to user: Instance 2939b24d-ed1a-4b5f-85c7-ba39b537afd2 could not be found. {{(pid=132289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:19.215955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO nova.api.openstack.requestlog [None req-a2c1c865-e036-4204-8a51-2a805ae272e2 tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2" status: 404 len: 111 microversion: 2.1 time: 0.031398 Aug 24 15:50:19.215955 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: [pid: 132289|app: 0|req: 507/1007] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:19 2022] GET /compute/v2.1/servers/2939b24d-ed1a-4b5f-85c7-ba39b537afd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:20.500715 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: DEBUG nova.api.openstack.wsgi [None req-088d511c-5806-44b8-af15-bc885ac388ee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] Calling method '.version_select at 0x7f07834ed040>' {{(pid=132288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:20.523107 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO nova.api.openstack.requestlog [None req-088d511c-5806-44b8-af15-bc885ac388ee tempest-TestVolumeBootPattern-1802697822 tempest-TestVolumeBootPattern-1802697822-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-292842636" status: 202 len: 0 microversion: 2.1 time: 0.026879 Aug 24 15:50:20.523687 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: [pid: 132288|app: 0|req: 501/1008] 10.222.0.73 () {58 vars in 1260 bytes} [Wed Aug 24 15:50:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-292842636 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:50:48.145635 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:50:48.146277 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Wed Aug 24 15:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:51:02.078062 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:51:02.078667 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Wed Aug 24 15:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:51:05.546573 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:51:05.547177 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Wed Aug 24 15:51:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:52:27.094788 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:52:27.095448 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Wed Aug 24 15:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:52:45.246825 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:52:45.247458 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Wed Aug 24 15:52:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:52:50.834258 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:52:50.834890 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Wed Aug 24 15:52:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:54:08.154162 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:54:08.154937 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Wed Aug 24 15:54:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:54:22.086655 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:54:22.087280 dv-cinder-846054-2-iscsi devstack@n-api.service[132288]: Wed Aug 24 15:54:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:54:25.554833 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:54:25.555404 dv-cinder-846054-2-iscsi devstack@n-api.service[132289]: Wed Aug 24 15:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!